-- Logs begin at Mon 2022-08-08 15:47:11 UTC, end at Mon 2022-08-08 17:50:28 UTC. -- Aug 08 16:50:58.036090 dv-cinder-852210-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 16:50:58.048985 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 16:50:58 2022] *** Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: nodename: dv-cinder-852210-3-iscsi Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: machine: x86_64 Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: clock source: unix Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: pcre jit disabled Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: detected number of CPU cores: 4 Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: current working directory: / Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: detected binary path: /usr/bin/uwsgi-core Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: your processes number limit is 47680 Aug 08 16:50:58.051729 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: your memory page size is 4096 bytes Aug 08 16:50:58.052570 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: detected max file descriptor number: 2048 Aug 08 16:50:58.052570 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: lock engine: pthread robust mutexes Aug 08 16:50:58.052570 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: thunder lock: enabled Aug 08 16:50:58.052570 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 16:50:58.052570 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 16:50:58.094285 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: Python main interpreter initialized at 0x55b884a099c0 Aug 08 16:50:58.094285 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: python threads support enabled Aug 08 16:50:58.094285 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: your server socket listen backlog is limited to 100 connections Aug 08 16:50:58.094285 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: your mercy for graceful operations on workers is 90 seconds Aug 08 16:50:58.094840 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 16:50:58.094840 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: *** Operational MODE: preforking *** Aug 08 16:50:58.095018 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: *** uWSGI is running in multiple interpreter mode *** Aug 08 16:50:58.095018 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: spawned uWSGI master process (pid: 115511) Aug 08 16:50:58.095240 dv-cinder-852210-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 16:50:58.096677 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: spawned uWSGI worker 1 (pid: 115512, cores: 1) Aug 08 16:50:58.096677 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: spawned uWSGI worker 2 (pid: 115513, cores: 1) Aug 08 16:50:58.096677 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 16:50:58.797600 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:50:58.882554 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:50:59.922165 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:50:59.922165 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: from cryptography.utils import int_from_bytes Aug 08 16:50:59.922859 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:50:59.922859 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: from cryptography.utils import int_from_bytes Aug 08 16:51:00.025468 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:00.025468 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: from cryptography.utils import int_from_bytes Aug 08 16:51:00.026430 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:00.026430 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: from cryptography.utils import int_from_bytes Aug 08 16:51:02.489119 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:51:02.489776 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:51:02.490077 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:51:02.490270 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:51:02.490520 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:51:02.490908 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.491230 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.491550 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.491867 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.492194 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.492556 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.492875 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.493189 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.493514 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.493771 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.494129 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.494438 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-3-iscsi {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.494765 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.495068 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.495377 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.495694 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.495999 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.496311 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.496612 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.497113 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.497646 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.497862 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.498174 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.498510 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.498923 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.499127 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.499470 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.500298 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.500623 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.500936 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.501396 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-3-iscsi {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.501716 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.502055 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.502370 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.502786 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.503097 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.503410 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.503774 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.504098 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.504403 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.504728 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.505046 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.505368 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.505686 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.506013 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.506324 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.506634 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.506989 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.507289 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.507594 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.507841 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.508155 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.508480 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.508796 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.509118 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.509369 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.509627 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.510029 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.510351 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.510659 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.510966 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.511269 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.511572 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.511878 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.512182 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.512485 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.512790 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.513109 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.513421 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.513741 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.514073 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.514391 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.514791 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.515069 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.515423 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.515765 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.516084 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.516395 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.516713 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.517032 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.517339 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.517646 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.517976 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.518297 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.518637 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.518940 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.519187 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.519488 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.519791 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.520112 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.520451 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.520720 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.521102 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.521324 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.521626 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.521954 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.522258 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.522560 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.522864 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.523169 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.523479 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.523777 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.524104 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.524500 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.524820 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.525126 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.525432 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.525736 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.526074 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.526386 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.526714 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.527017 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.527334 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.527640 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.527943 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.528262 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.528569 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.528876 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.529188 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.529489 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.529827 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.530136 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.530442 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.530775 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.531079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.531381 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.531683 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.531982 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.532288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.532586 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.532886 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.533198 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.533518 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.533840 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.534156 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.534453 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.534775 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.535111 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.535446 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.535781 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.536102 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.536430 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.536766 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.537083 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.537398 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.537711 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.538066 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.538376 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.538636 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:51:02.539253 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.539400 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:51:02.539499 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.539499 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.539726 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:51:02.539885 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.540015 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:51:02.540127 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.540237 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:51:02.540374 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.540511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.540653 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.540795 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.540887 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.541062 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.541228 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.541368 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.541557 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.541688 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.541845 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.541993 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.542131 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.542283 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.542423 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.542577 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.542763 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.542939 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.543107 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.543224 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.543418 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.543555 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.543743 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.543848 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-3-iscsi {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.544072 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.544217 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.544371 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.544486 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.544678 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.544837 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.545042 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.545155 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.545292 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.545504 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.545633 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.545745 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.545902 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.546056 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.546271 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.546948 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.547125 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.547318 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.547455 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.547693 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.547826 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.548006 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.548294 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.548429 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.548641 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.548815 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.548958 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.549257 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.549399 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.549569 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.549816 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.549954 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.550221 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.550365 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.550531 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.550701 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.550853 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.551140 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.551274 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.551446 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.551730 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.551867 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.552047 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.552337 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-3-iscsi {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.552472 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.552653 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.552886 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.553016 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.553272 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.553402 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.553605 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.553938 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.554099 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.554251 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.554404 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.554534 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.554663 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.554841 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.554984 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.555147 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.555310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.555458 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.555605 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.555758 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.555924 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.556056 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.556253 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.556390 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.556580 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.556690 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.556907 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.557127 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.557260 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.557375 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.557516 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.557655 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.557872 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.558023 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.558153 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.558248 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.558464 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.558555 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.558768 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.558936 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.559076 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.559159 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.559324 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.559417 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.559636 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.559774 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.559958 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.560060 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.560280 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.560425 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.560605 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.560750 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.560942 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.561045 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.561127 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.561275 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.561382 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.561601 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.561734 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.561976 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.562067 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.562296 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.562395 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.562600 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.562684 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.562910 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.563005 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.563744 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.563839 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.564050 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.564141 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.564358 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.564449 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.564685 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.564777 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.564972 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.565110 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.565279 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.565372 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.565584 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.565707 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.566163 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.566284 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.566471 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.566556 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.566796 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.566906 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.567108 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.567277 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.567409 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.567496 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.567715 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.567811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.568029 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.568119 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.568362 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.568460 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.568661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.568744 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.568980 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.569077 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.569290 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.569394 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.569598 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.569757 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.569929 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.570090 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.570261 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.570471 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.570624 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.570798 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.570943 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.571090 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.571232 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.571386 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.571528 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.571669 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.571829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.571967 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.572124 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.572283 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.572422 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.572572 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.572730 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.572868 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.573026 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.573179 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.573316 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.573453 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.573591 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.573730 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.573919 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.574076 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.574216 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.574352 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.574513 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.574650 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.574801 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.575013 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.575173 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.575309 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.575461 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.575600 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.575996 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.576148 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.576301 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.576441 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.576585 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.576737 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.577035 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.577184 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.577348 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.577636 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.577864 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.578024 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.578201 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.578348 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.578659 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.578792 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.578958 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.579252 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.579384 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.579577 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.579801 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.579943 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.580186 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.580280 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.580499 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.580754 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.580845 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.581153 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.581239 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.581462 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.581693 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.581777 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.582105 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.582664 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.582786 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.582972 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.583079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.583079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.583282 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.583384 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.583594 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.583708 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.583903 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.584132 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.584243 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.584512 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.584644 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.584831 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.585096 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.585217 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.585409 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.585550 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.585715 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.586040 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.586162 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.586339 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.586477 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.586649 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.586965 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.587087 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.587272 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.587506 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.587622 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.587901 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.587989 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.588206 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.588415 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.588499 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.588815 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.588901 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.589124 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.589415 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.589532 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.589728 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.589982 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.590076 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.590388 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.590483 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.590704 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.590900 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.591113 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.591310 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.591399 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.591630 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.591908 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.592010 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.592232 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.592367 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.592570 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.592730 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.592850 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.593145 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.593239 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:02.593491 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.593731 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.593940 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.594121 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.594296 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.594429 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.594738 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.594837 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595045 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595331 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595461 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595682 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595852 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.595992 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.596302 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.596438 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.596603 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.596725 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.596910 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.597164 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.597251 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.597538 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.597816 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598053 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598149 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598453 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598538 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598773 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.598954 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.599092 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.599411 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.599510 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.599739 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.599881 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.600072 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.600342 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.600437 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.600723 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.600859 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.601033 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.601338 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.601428 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.601642 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.601909 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602029 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602268 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602428 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602574 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602881 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.602985 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.603185 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.603400 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.603534 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.603780 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.603944 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.604114 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.604416 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.604518 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.604731 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.604954 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.605038 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.605333 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.605590 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.605704 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.605973 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.606145 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.606280 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.606574 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.606679 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.606880 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.607151 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.607237 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.607504 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.607689 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.607811 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.608149 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.608247 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.608472 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.608714 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.609322 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.609634 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.609719 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.609962 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.610238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.610323 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.610575 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.610816 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.610943 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.611168 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.611305 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.611475 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.611780 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.611873 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.612079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.612254 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.612391 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.612697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.612802 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.613004 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.613317 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.613503 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.613647 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.613931 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.614095 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.614223 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.614496 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.614659 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.614812 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615099 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615395 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615395 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615685 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615834 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.615961 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.616241 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.616419 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.616573 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.617326 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.617450 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.617450 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.617450 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.617900 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618017 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618127 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618326 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618494 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618657 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.618954 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.619124 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.619276 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.619489 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.619641 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.619855 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620040 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620167 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620379 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620613 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620812 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.620963 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.621124 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.621266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.621573 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.621850 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622015 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622205 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622351 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622495 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622721 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.622872 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623112 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623295 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623400 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623662 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623842 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.623963 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.624270 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.624491 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.625142 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.625438 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.625533 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.625742 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.626013 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.626134 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.626529 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.626621 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.627026 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.627197 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.627539 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.627635 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.628022 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.628136 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.628670 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.628782 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.629184 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.629269 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.629766 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.629896 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.630243 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.630415 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.630735 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.631020 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.631276 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.631635 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.631760 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.632076 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.632219 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.632440 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.632750 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.632919 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.633283 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.633377 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.633756 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.633936 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.634274 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.634420 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.634810 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.634956 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.635353 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.635517 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.635872 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.636088 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.636352 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.636739 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.636913 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.637401 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.637555 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.637920 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.638090 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.638412 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.638550 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.638772 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.638974 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.639140 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.639426 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.639543 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.639812 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.639937 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.640196 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.640349 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.640577 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.640712 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.640946 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.641127 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.641275 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.641568 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.641719 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.641973 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.642135 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.642273 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.642599 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.642756 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.642901 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.643105 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.643263 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.643540 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.643711 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.643880 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.644028 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.644227 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.644501 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.644641 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.644868 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.645068 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.645215 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.645474 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.645617 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.645844 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.646012 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.646210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.646419 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.646558 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.646866 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.647055 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.647235 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.647484 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.647645 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.647814 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648110 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648279 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648474 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648720 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648855 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.648998 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.649150 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.649313 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.649459 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.649837 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.649983 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.650158 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.650301 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.650473 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.650783 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.650930 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.651079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.651199 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.651384 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.651671 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.651784 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652007 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652179 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652303 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652612 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652720 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.652948 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653173 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653330 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653498 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653641 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653848 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.653991 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.654175 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.654437 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.654582 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.654837 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.654995 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655150 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655295 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655458 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655598 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655812 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.655969 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656184 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656325 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656526 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656624 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656846 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.656931 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657172 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657488 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657593 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657818 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.657906 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658136 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658229 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658558 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658764 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.658891 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659075 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659170 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659393 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659486 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659698 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.659781 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660013 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660105 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660325 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660410 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660635 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660718 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.660949 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661039 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661270 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661356 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661579 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661716 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.661914 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662013 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662247 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662335 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662580 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662665 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662893 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.662977 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663207 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663294 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663514 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663597 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663826 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.663985 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664128 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664251 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664485 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664633 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664783 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.664994 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665146 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665235 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665319 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665482 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665622 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665846 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.665949 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666129 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666243 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666446 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666562 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666752 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.666866 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667068 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667187 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667382 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667498 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667691 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667819 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.667997 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668127 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668429 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668635 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668749 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.668946 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669055 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669269 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669352 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669593 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669675 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.669962 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670047 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670265 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670354 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670590 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670672 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670900 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.670974 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.671203 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.671786 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672027 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672103 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672335 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672418 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672678 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.672765 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673027 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673113 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673310 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673405 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673625 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673719 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.673973 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674059 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674277 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674360 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674579 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674666 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674891 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.674991 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675195 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675322 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675501 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675608 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675806 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.675979 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676134 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676286 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676435 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676580 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676731 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.676868 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677002 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677150 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677280 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677417 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677546 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677741 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.677929 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678073 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678202 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678420 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678569 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678726 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.678811 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679032 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679119 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679343 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679427 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679659 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679752 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.679986 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680244 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680339 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680576 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680892 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.680978 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681202 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681286 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681515 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681599 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681852 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.681942 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682166 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682302 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682480 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682617 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682791 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.682889 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683097 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683204 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683412 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683513 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683714 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.683813 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684018 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684103 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684328 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684569 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684663 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.684900 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685049 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685215 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685359 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685525 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685625 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685845 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.685930 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686154 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686240 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686463 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686556 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686764 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.686848 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.687624 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.687765 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.687986 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688099 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688331 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688540 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688626 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.688871 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689001 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689174 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689311 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689472 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689559 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689775 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.689912 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690100 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690193 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690443 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690528 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690748 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.690833 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.691348 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.691443 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.691678 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.691791 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692027 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692197 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692384 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692662 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692839 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.692952 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693047 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693119 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693339 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693443 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693535 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693617 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693819 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.693960 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694131 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694229 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694439 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694741 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.694829 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695050 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695137 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695356 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695452 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695663 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695752 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.695968 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696068 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696272 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696382 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696579 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696670 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696880 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.696967 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.697192 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.697277 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.697497 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.697724 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.697835 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698063 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698191 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698397 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698516 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698711 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.698825 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699014 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699101 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699319 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699418 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699619 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699725 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.699939 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700094 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700264 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700389 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700542 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700679 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.700851 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701015 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701153 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701269 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701420 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701543 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.701712 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702017 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702158 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702278 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702464 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702655 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.702811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.703060 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.703185 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.703298 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.703808 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.703942 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704104 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704104 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704340 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704471 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704598 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704714 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.704873 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705100 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705229 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705379 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705495 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705637 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705772 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.705942 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706077 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706227 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706367 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706510 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706655 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706793 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.706970 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707141 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707279 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707412 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707558 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707681 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707801 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.707926 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708050 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708180 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708454 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708631 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708781 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.708965 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709107 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709256 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709392 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709525 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709660 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709810 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.709956 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710102 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710231 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710367 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710497 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710637 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710737 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710830 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.710912 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711100 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711199 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711417 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711506 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711717 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.711826 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712028 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712160 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712327 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712505 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712665 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.712803 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713002 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713180 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713334 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713486 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713721 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.713887 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714023 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714160 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714297 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714455 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714628 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714760 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.714917 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715046 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715164 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715322 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715446 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715573 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715690 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715805 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.715932 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716065 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716221 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716348 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716575 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716737 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.716877 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717036 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717165 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717309 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717426 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717714 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.717935 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.718124 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.718281 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.718551 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.718746 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.718884 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719110 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719280 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719408 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719536 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719691 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.719986 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720124 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720328 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720471 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720639 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720802 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.720948 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.721096 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.721264 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.721404 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.721564 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.721887 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722074 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722204 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722348 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722458 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722550 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722703 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.722793 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.723018 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.723249 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.723338 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.723627 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.723879 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724017 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724202 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724337 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724522 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724685 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724820 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.724953 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.725129 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.725305 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.725439 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.725651 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.725823 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726016 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726173 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726364 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726522 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726703 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726703 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.726970 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727088 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727205 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727348 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727484 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727609 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727728 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.727883 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728015 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728198 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728322 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728528 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728658 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728867 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.728994 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.729175 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.729348 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.729504 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.729679 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.729895 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730051 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730234 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730398 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730536 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730713 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.730841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731007 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731137 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731264 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731393 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731562 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731703 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.731877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732092 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732234 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732403 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732544 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732715 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.732882 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.733031 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.733242 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.733393 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.733590 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.733723 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.734548 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.734716 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.734808 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.734916 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735023 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735118 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735229 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735414 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735542 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735738 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.735827 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736057 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736207 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736352 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736523 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736713 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.736877 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737064 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737208 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737357 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737499 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737670 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.737847 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.738031 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.738121 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.738424 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.738599 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.738730 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739012 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739384 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739516 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739617 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739901 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.739999 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.740202 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.740486 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.740578 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.740797 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741090 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741255 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741452 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741630 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741744 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.741974 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.742086 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.742337 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.742464 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.742720 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.742835 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.743079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.743348 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.743450 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.743684 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.743781 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744010 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744115 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744318 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744417 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744638 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744737 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.744957 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745049 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745277 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745397 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745585 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745735 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.745963 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746102 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746472 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746566 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746680 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746785 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.746868 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747108 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747312 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747432 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747539 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747730 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.747820 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748063 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748218 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748389 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748536 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748712 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.748911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.749180 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.749440 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.749662 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.749952 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750195 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750357 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750488 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750599 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750759 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750846 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.750915 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751047 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751205 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751356 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751449 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751533 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751607 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751775 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.751872 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752079 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752173 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752400 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752528 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752719 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.752811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753002 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753091 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753321 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753530 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753654 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.753871 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754089 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754287 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754445 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754579 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754776 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754873 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.754956 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755036 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755252 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755353 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755599 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755701 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.755912 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756018 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756300 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756397 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756610 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756699 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.756915 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757002 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757237 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757356 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757547 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757691 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.757803 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:51:02.757891 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.758203 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.758507 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.758815 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.759119 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.759458 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.759770 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.760090 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.760405 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.760728 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.761035 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.761349 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.761663 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.761999 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.762312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.762654 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.762941 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.763248 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.763562 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.763873 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.764185 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.764770 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.765360 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.765515 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.765912 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.766227 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.766470 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.766781 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.767092 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.767402 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.767713 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.768028 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.768351 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.768668 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.768993 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.769322 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.769639 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.769977 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.770293 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.770606 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.770961 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.771275 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.771578 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.771890 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.772202 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.772515 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.772825 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.773134 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.773446 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.773756 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.774088 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.774396 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.774708 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.775021 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.775342 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.775678 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.775994 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.776306 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.776618 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.776931 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.777455 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.777766 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.778121 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.778445 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.778768 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.779083 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.779399 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.779725 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.780028 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.780329 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.780637 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.781493 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.781891 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.782342 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.782428 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.782722 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.783040 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.783350 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.783881 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.784228 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.784545 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.784871 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.785194 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.785511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.785873 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.786245 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.786466 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.786775 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.787087 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.787404 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.787695 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.788000 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.788308 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.788614 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.788914 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.789221 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.789516 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.789906 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.790196 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.790495 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.790775 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.791087 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.791388 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.791689 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.791991 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.792292 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.792638 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.792946 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.793240 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.793542 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.793874 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.794181 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.794489 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.794792 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.795139 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.795423 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.795767 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.796094 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.796948 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.797282 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.797596 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.797935 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.798283 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.798599 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.799176 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.799513 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.799829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.800169 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.800504 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.800811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.801114 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.801420 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.801744 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.802080 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.802390 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.802699 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.803008 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.803334 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.803635 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.803943 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.804238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.804544 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.804850 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.805168 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.805459 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.805766 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.806135 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.806411 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.806751 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.807067 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.807379 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.807691 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.808005 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.808315 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.808621 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.808929 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.809235 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.809549 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.809911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.810227 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.810533 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.810969 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.811281 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.811599 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.811934 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.812255 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.812582 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.812901 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.813212 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.813532 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.813869 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.814201 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.814548 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.814881 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.815205 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.815512 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.815814 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.816436 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.816682 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.817021 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.817322 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.817615 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.817944 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.818252 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.818553 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.818855 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.819239 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.819512 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.819927 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.820067 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.820364 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.820660 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.820962 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.821261 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.821565 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.821902 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.822197 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.822502 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.822803 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.823107 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.823410 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.823757 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.824087 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.824400 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.824721 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.825031 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.825352 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.825661 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.826015 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.826339 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.826736 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.826949 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.827285 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.827625 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.827938 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.828249 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.828552 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.828860 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.829169 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.829506 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.829863 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.830170 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.830496 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.830811 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.831135 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.831450 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.831760 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.832098 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.832448 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.832716 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.833028 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.833365 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.833644 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.834012 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.834291 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.834609 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.834918 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.835303 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.835637 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.835972 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.836279 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.836603 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.836950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.837279 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.837588 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.837963 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.838290 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.838600 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.838910 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.839218 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:02.839462 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:51:02.911793 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO dbcounter [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Registered counter for database nova_api Aug 08 16:51:02.934953 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_db.sqlalchemy.engines [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:02.943333 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writer thread running {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.000408 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO dbcounter [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Registered counter for database nova_api Aug 08 16:51:03.005275 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.context [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3cbdaf28-93b6-4787-a2ab-078d88b45544(cell1) {{(pid=115512) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:51:03.009292 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:03.009773 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:03.011418 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:03.012160 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:03.012611 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:03.014692 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:03.016854 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO dbcounter [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Registered counter for database nova_cell0 Aug 08 16:51:03.023700 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO dbcounter [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Registered counter for database nova_cell1 Aug 08 16:51:03.029204 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_db.sqlalchemy.engines [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.032832 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_db.sqlalchemy.engines [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.034287 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_db.sqlalchemy.engines [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.040644 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writer thread running {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.043568 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writer thread running {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.045632 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writer thread running {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.118047 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.context [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3cbdaf28-93b6-4787-a2ab-078d88b45544(cell1) {{(pid=115513) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:51:03.122136 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:03.122617 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:03.124220 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:03.125001 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:03.125443 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:03.127775 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_concurrency.lockutils [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:03.129819 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO dbcounter [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Registered counter for database nova_cell0 Aug 08 16:51:03.135708 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO dbcounter [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Registered counter for database nova_cell1 Aug 08 16:51:03.144766 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_db.sqlalchemy.engines [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.146797 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_db.sqlalchemy.engines [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.154812 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writer thread running {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.159181 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writer thread running {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.206778 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO dbcounter [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Registered counter for database nova_cell0 Aug 08 16:51:03.214947 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_db.sqlalchemy.engines [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.222136 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writer thread running {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.307943 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO dbcounter [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Registered counter for database nova_cell0 Aug 08 16:51:03.315309 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG oslo_db.sqlalchemy.engines [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:03.320453 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writer thread running {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:03.688802 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: WARNING keystonemiddleware.auth_token [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:03.696566 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: WARNING keystonemiddleware.auth_token [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:03.781620 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: WARNING keystonemiddleware.auth_token [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:03.789277 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: WARNING keystonemiddleware.auth_token [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:04.046102 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: WARNING keystonemiddleware.auth_token [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:04.053311 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: WARNING keystonemiddleware.auth_token [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:04.059051 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b884a099c0 pid: 115512 (default app) Aug 08 16:51:04.061403 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:04.063566 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002713 Aug 08 16:51:04.064028 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Mon Aug 8 16:51:04 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:04.157166 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: WARNING keystonemiddleware.auth_token [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:04.163245 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: WARNING keystonemiddleware.auth_token [None req-bfca0975-64d1-4171-a1de-4ffc40f2a267 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:04.168540 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b884a099c0 pid: 115513 (default app) Aug 08 16:52:30.430196 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:30.431211 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 08 16:52:30.431597 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:30.447043 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_api:SELECT=3 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:30.448079 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_cell0:SELECT=3 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:30.449264 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_cell1:SELECT=3 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:30.450996 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:31.711222 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-18d16b52-f198-4b9b-b339-da1d237bc30f admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:31.746374 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-18d16b52-f198-4b9b-b339-da1d237bc30f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.306873 Aug 08 16:52:31.747492 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Aug 8 16:52:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:34.196924 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:34.197989 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-99b8ede4-6945-401c-868f-2501a2ad2843 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 08 16:52:34.198596 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:34.790804 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-e92635a1-07b9-44bb-b9f4-6bf93e196874 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:34.816002 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:52:34.816002 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: warnings.warn(msg) Aug 08 16:52:34.945416 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-e92635a1-07b9-44bb-b9f4-6bf93e196874 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.740439 Aug 08 16:52:34.946233 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:52:34.964742 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:SELECT=3 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:34.964742 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell1:SELECT=3 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:34.965656 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell0:SELECT=3 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:34.967194 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:35.180456 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-9d0733d9-49d6-4aea-86de-ccef2f9d9684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:35.189839 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:52:35.189839 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:52:35.334880 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-9d0733d9-49d6-4aea-86de-ccef2f9d9684 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.378566 Aug 08 16:52:35.335668 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Aug 8 16:52:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:37.672674 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-e92635a1-07b9-44bb-b9f4-6bf93e196874 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:37.680171 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-e92635a1-07b9-44bb-b9f4-6bf93e196874 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Aug 08 16:52:37.680171 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:38.495215 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-945f40c7-7d1d-459b-af21-1f08a898f8ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:38.515893 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:52:38.515893 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:52:38.712873 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-945f40c7-7d1d-459b-af21-1f08a898f8ac admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.030824 Aug 08 16:52:38.721818 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:52:38.737268 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-63e75bea-074f-479a-ae25-c091429f3255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:38.740293 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:52:38.740293 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: warnings.warn(msg) Aug 08 16:52:38.825106 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-63e75bea-074f-479a-ae25-c091429f3255 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096253 Aug 08 16:52:38.826324 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Aug 8 16:52:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:41.151980 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-945f40c7-7d1d-459b-af21-1f08a898f8ac admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:41.153200 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-945f40c7-7d1d-459b-af21-1f08a898f8ac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 08 16:52:41.154235 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:41.579743 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-a75190c6-3ba3-4e41-84a7-1342001c1a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:41.695626 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-a75190c6-3ba3-4e41-84a7-1342001c1a09 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534318 Aug 08 16:52:41.696682 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:52:41.719757 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-9f01c311-ac8a-4a0b-926b-69fd03fbd467 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:41.823460 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-9f01c311-ac8a-4a0b-926b-69fd03fbd467 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111314 Aug 08 16:52:41.824500 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Aug 8 16:52:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:44.224576 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-a75190c6-3ba3-4e41-84a7-1342001c1a09 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:44.225658 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-a75190c6-3ba3-4e41-84a7-1342001c1a09 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 08 16:52:44.226088 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:52:44.896338 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-cf6b5709-2496-4cdc-aa4f-be0983eef856 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:45.020426 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-cf6b5709-2496-4cdc-aa4f-be0983eef856 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.785452 Aug 08 16:52:45.021026 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:52:45.033891 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-8ddf1475-54ac-4be3-a1f9-86a36deca1cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:45.212825 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-8ddf1475-54ac-4be3-a1f9-86a36deca1cd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.182482 Aug 08 16:52:45.213531 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Aug 8 16:52:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:47.570541 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-cf6b5709-2496-4cdc-aa4f-be0983eef856 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:47.578040 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-cf6b5709-2496-4cdc-aa4f-be0983eef856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 08 16:52:47.578040 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:48.209273 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:48.424739 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.846329 Aug 08 16:52:48.425290 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:52:48.440695 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-7bdf0d65-fb6b-4c30-b769-8fd7461ac6cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:48.597421 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-7bdf0d65-fb6b-4c30-b769-8fd7461ac6cb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160768 Aug 08 16:52:48.598086 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Aug 8 16:52:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:51.300299 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:51.301948 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002436 Aug 08 16:52:51.302662 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:51.792812 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-66a91f7e-e57e-4cc4-b59a-0df850feb86e admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:51.818857 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-66a91f7e-e57e-4cc4-b59a-0df850feb86e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.509790 Aug 08 16:52:51.819658 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Aug 8 16:52:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:52:54.357122 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:54.358156 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-cf020110-2884-494e-8697-807fc4b8ad85 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Aug 08 16:52:54.358565 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:54.925488 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-121bf48a-06a0-4e3a-99d8-ff3fd2c8d70c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "1", "name": "m1.tiny"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:55.042688 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-121bf48a-06a0-4e3a-99d8-ff3fd2c8d70c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.677364 Aug 08 16:52:55.043450 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:52:55.055830 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-9b0357ea-5b25-4b79-81a3-ed4cf13ab6db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:55.216564 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-9b0357ea-5b25-4b79-81a3-ed4cf13ab6db admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163541 Aug 08 16:52:55.217424 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Aug 8 16:52:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:57.587264 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-121bf48a-06a0-4e3a-99d8-ff3fd2c8d70c admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:57.588276 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-121bf48a-06a0-4e3a-99d8-ff3fd2c8d70c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 08 16:52:57.588868 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:58.045320 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-24813af6-72c0-41da-88fe-8becb99e0158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "id": "2"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:58.180440 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-24813af6-72c0-41da-88fe-8becb99e0158 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.584707 Aug 08 16:52:58.181088 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:52:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:52:58.193977 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-944516c4-cb49-4f99-b52d-add28115fed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:58.322979 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-944516c4-cb49-4f99-b52d-add28115fed1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132954 Aug 08 16:52:58.323586 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Aug 8 16:52:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:00.741576 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-24813af6-72c0-41da-88fe-8becb99e0158 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:00.743324 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-24813af6-72c0-41da-88fe-8becb99e0158 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Aug 08 16:53:00.744121 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:01.379630 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-9402d217-78b9-43c8-977b-015ebebcd725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:01.509194 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-9402d217-78b9-43c8-977b-015ebebcd725 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.755715 Aug 08 16:53:01.521312 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:53:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:01.529006 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-58fc6dcb-7f64-46a8-b002-b573e98b11a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:01.533940 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:01.693171 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-58fc6dcb-7f64-46a8-b002-b573e98b11a9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.168720 Aug 08 16:53:01.709210 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Aug 8 16:53:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:04.575695 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-9402d217-78b9-43c8-977b-015ebebcd725 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:04.576713 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-9402d217-78b9-43c8-977b-015ebebcd725 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Aug 08 16:53:04.577128 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:05.262426 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-dd22d6d9-4ffa-4bff-8c24-071b2c30dc2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:06.251433 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-dd22d6d9-4ffa-4bff-8c24-071b2c30dc2b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.667228 Aug 08 16:53:06.252771 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:53:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:53:06.268621 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-f90e8720-4d41-410f-a5b0-a375f790b37c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:06.479907 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-f90e8720-4d41-410f-a5b0-a375f790b37c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.216021 Aug 08 16:53:06.481572 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Aug 8 16:53:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:09.229564 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-dd22d6d9-4ffa-4bff-8c24-071b2c30dc2b admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:09.232229 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-dd22d6d9-4ffa-4bff-8c24-071b2c30dc2b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003026 Aug 08 16:53:09.240638 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:53:09 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:53:09.901160 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "name": "m1.xlarge"}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:09.911067 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:10.015609 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.773581 Aug 08 16:53:10.029555 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Aug 8 16:53:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:10.035514 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-8e4a7c15-9b2d-4d1b-b55c-e41c2ff70c96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:10.174457 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-8e4a7c15-9b2d-4d1b-b55c-e41c2ff70c96 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143273 Aug 08 16:53:10.176672 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Aug 8 16:53:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:28.850207 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:28.851119 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 08 16:53:28.851529 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:28.863259 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:29.293061 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-c93335a9-f45d-4ea7-91c4-f70ce5fe233d admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:29.311926 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-c93335a9-f45d-4ea7-91c4-f70ce5fe233d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.453441 Aug 08 16:53:29.312726 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Aug 8 16:53:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:53:30.453039 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:30.454851 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-de4ae9aa-422a-44b4-8a1a-29f2e41c2f0c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002304 Aug 08 16:53:30.455601 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:31.033827 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-ed5e3594-1cb3-4ba8-8808-63735c6afcee admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.039722 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.wsgi [None req-ed5e3594-1cb3-4ba8-8808-63735c6afcee admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-ed5e3594-1cb3-4ba8-8808-63735c6afcee admin admin] Request method failure captured: Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept: application/json Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept-Encoding: gzip, deflate Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Connection: keep-alive Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Content-Length: 0 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Host: 10.222.0.57 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-System-Scope: None Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: User-Agent: python-novaclient Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Auth-Token: gAAAAABi8T-K7o1G9q10rDupNpafvpf7pYTBdiDccGmqhAwSbxS2NULHNuGdC0_70OTmfwI3Wyq-zxeNvgIS1JI9-rFiLeU9iHX1wzT491iJrPDjiw8ex1Km2Vj2vZKqux0T9N5PISmDVxCaPWrLLB2hhpeAeMI6w2gBBm0BjviGuz2ZUKyO46M Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Id: None Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Name: None Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Identity-Status: Confirmed Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Is-Admin-Project: True Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Id: default Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Name: Default Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Name: admin Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Role: member,admin,reader Aug 08 16:53:31.044310 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Roles: member,admin,reader Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant: admin Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Name: admin Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User: admin Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Id: default Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Name: Default Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Name: admin Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: method: > Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: exception: Flavor 42 could not be found. Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: action_args: {'id': '42'} Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:31.046950 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:31.048238 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.049511 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-ed5e3594-1cb3-4ba8-8808-63735c6afcee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:31.050646 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-ed5e3594-1cb3-4ba8-8808-63735c6afcee admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.447453 Aug 08 16:53:31.050646 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Aug 8 16:53:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:31.059016 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-2f6ace9c-4deb-491a-a29b-05f9c9adc749 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.086950 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-2f6ace9c-4deb-491a-a29b-05f9c9adc749 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032372 Aug 08 16:53:31.087547 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:53:31.098897 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-6b747f16-4934-44be-8383-7c6526f81dad admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.141894 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-6b747f16-4934-44be-8383-7c6526f81dad admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028391 Aug 08 16:53:31.141894 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:53:31.151133 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-216d7794-dfaf-4980-b537-521e626b6dff admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.158247 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.wsgi [None req-216d7794-dfaf-4980-b537-521e626b6dff admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-216d7794-dfaf-4980-b537-521e626b6dff admin admin] Request method failure captured: Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept: application/json Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept-Encoding: gzip, deflate Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Connection: keep-alive Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Content-Length: 0 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Host: 10.222.0.57 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-System-Scope: None Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: User-Agent: python-novaclient Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Auth-Token: gAAAAABi8T-K7o1G9q10rDupNpafvpf7pYTBdiDccGmqhAwSbxS2NULHNuGdC0_70OTmfwI3Wyq-zxeNvgIS1JI9-rFiLeU9iHX1wzT491iJrPDjiw8ex1Km2Vj2vZKqux0T9N5PISmDVxCaPWrLLB2hhpeAeMI6w2gBBm0BjviGuz2ZUKyO46M Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Id: None Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Name: None Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Identity-Status: Confirmed Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Is-Admin-Project: True Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Id: default Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Name: Default Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Name: admin Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Role: member,admin,reader Aug 08 16:53:31.161565 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Roles: member,admin,reader Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant: admin Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Name: admin Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User: admin Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Id: default Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Name: Default Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Name: admin Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: method: > Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: exception: Flavor 42 could not be found. Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: action_args: {'id': '42'} Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:31.162906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:31.163697 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:31.164877 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-216d7794-dfaf-4980-b537-521e626b6dff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:31.165924 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-216d7794-dfaf-4980-b537-521e626b6dff admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015795 Aug 08 16:53:31.165924 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Aug 8 16:53:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:32.194558 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-6b747f16-4934-44be-8383-7c6526f81dad admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.195567 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-6b747f16-4934-44be-8383-7c6526f81dad admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 08 16:53:32.195977 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:53:32.787814 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-8a98f9e4-78e5-4fd4-94be-b40443cc6274 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.794136 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.wsgi [None req-8a98f9e4-78e5-4fd4-94be-b40443cc6274 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-8a98f9e4-78e5-4fd4-94be-b40443cc6274 admin admin] Request method failure captured: Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept: application/json Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept-Encoding: gzip, deflate Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Connection: keep-alive Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Content-Length: 0 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Host: 10.222.0.57 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-System-Scope: None Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: User-Agent: python-novaclient Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Auth-Token: gAAAAABi8T-MBNgrQAVM2FBn_ycLINm1mHRotPNgMkTtHgVsO4M5J4ZBuMrfS7Pgs62mbU45t2lmGItwddA9_dFstUjFInFaqAOImPgrJNM2ddGfRymKyi-DHwnpdHYzgcXpowhDu5UnYUxNqzYSt-CCUiUnYiwbOufOv3yGQvo0xVLbuSjpo8Q Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Id: None Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Name: None Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Identity-Status: Confirmed Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Is-Admin-Project: True Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Id: default Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Name: Default Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Name: admin Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Role: member,admin,reader Aug 08 16:53:32.795661 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Roles: member,admin,reader Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant: admin Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Name: admin Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User: admin Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Id: default Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Name: Default Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Name: admin Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: method: > Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: exception: Flavor 84 could not be found. Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: action_args: {'id': '84'} Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:32.797288 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:32.798266 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.799521 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-8a98f9e4-78e5-4fd4-94be-b40443cc6274 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:32.800931 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-8a98f9e4-78e5-4fd4-94be-b40443cc6274 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.450135 Aug 08 16:53:32.801930 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:32.807390 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-0cb49e4f-8a81-4ab5-a71c-a7797ec3886d admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.824106 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-0cb49e4f-8a81-4ab5-a71c-a7797ec3886d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020393 Aug 08 16:53:32.826521 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:53:32.834663 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-28ae8bcf-ecb0-4d9c-8cd6-ec1c27b2734f admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.852240 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-28ae8bcf-ecb0-4d9c-8cd6-ec1c27b2734f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021128 Aug 08 16:53:32.852790 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:53:32.865968 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-42889ee5-10b0-45ab-ae74-e82cdee8013f admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.871719 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.wsgi [None req-42889ee5-10b0-45ab-ae74-e82cdee8013f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-42889ee5-10b0-45ab-ae74-e82cdee8013f admin admin] Request method failure captured: Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept: application/json Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept-Encoding: gzip, deflate Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Connection: keep-alive Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Content-Length: 0 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Host: 10.222.0.57 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-System-Scope: None Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: User-Agent: python-novaclient Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Auth-Token: gAAAAABi8T-MBNgrQAVM2FBn_ycLINm1mHRotPNgMkTtHgVsO4M5J4ZBuMrfS7Pgs62mbU45t2lmGItwddA9_dFstUjFInFaqAOImPgrJNM2ddGfRymKyi-DHwnpdHYzgcXpowhDu5UnYUxNqzYSt-CCUiUnYiwbOufOv3yGQvo0xVLbuSjpo8Q Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Id: None Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Name: None Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Identity-Status: Confirmed Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Is-Admin-Project: True Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Id: default Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Name: Default Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Name: admin Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Role: member,admin,reader Aug 08 16:53:32.873271 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Roles: member,admin,reader Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant: admin Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Name: admin Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User: admin Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Id: default Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Name: Default Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Name: admin Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: method: > Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: exception: Flavor 84 could not be found. Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: action_args: {'id': '84'} Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:32.874841 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:32.882829 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:32.884126 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-42889ee5-10b0-45ab-ae74-e82cdee8013f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:32.885346 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-42889ee5-10b0-45ab-ae74-e82cdee8013f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013475 Aug 08 16:53:32.885346 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:33.915500 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-28ae8bcf-ecb0-4d9c-8cd6-ec1c27b2734f admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:33.917489 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-28ae8bcf-ecb0-4d9c-8cd6-ec1c27b2734f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Aug 08 16:53:33.918205 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:34.473234 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-28c1f54f-2caf-4afb-98a8-361fa9465152 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.482441 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.wsgi [None req-28c1f54f-2caf-4afb-98a8-361fa9465152 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-28c1f54f-2caf-4afb-98a8-361fa9465152 admin admin] Request method failure captured: Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept: application/json Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Accept-Encoding: gzip, deflate Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Connection: keep-alive Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Content-Length: 0 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Host: 10.222.0.57 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Openstack-System-Scope: None Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: User-Agent: python-novaclient Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Auth-Token: gAAAAABi8T-NcY-7YKCb1F8xdt95quVC9aNpFJudAjxb1dvjxdUbpGzTGRD6MngnKEIX0k6vEHwBHow3KLHVry33SUPKdXtBN6aVcg4zLwSvhDmAZOmnK3-JGxJivKH7QcB8dmHsiyXhZkplBUmH33Bjtfz-Mr4JbR4w2nKX8L3MVxBvh-q-GVM Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Id: None Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Domain-Name: None Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Identity-Status: Confirmed Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Is-Admin-Project: True Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Id: default Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Domain-Name: Default Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Project-Name: admin Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Role: member,admin,reader Aug 08 16:53:34.484911 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Roles: member,admin,reader Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant: admin Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-Tenant-Name: admin Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User: admin Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Id: default Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Domain-Name: Default Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: X-User-Name: admin Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: method: > Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: exception: Flavor 451 could not be found. Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: action_args: {'id': '451'} Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:34.486469 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:34.487312 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.488451 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-28c1f54f-2caf-4afb-98a8-361fa9465152 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:34.489507 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-28c1f54f-2caf-4afb-98a8-361fa9465152 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.418918 Aug 08 16:53:34.489507 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:34.497242 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-6e02865a-65ec-436a-b08a-722dd7ae6a52 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.513753 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-6e02865a-65ec-436a-b08a-722dd7ae6a52 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021024 Aug 08 16:53:34.514344 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:53:34.524545 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.542885 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022111 Aug 08 16:53:34.543434 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:53:34.553538 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-972a3991-aacb-4b69-91ec-05c06f148a2b admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.559896 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.wsgi [None req-972a3991-aacb-4b69-91ec-05c06f148a2b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-972a3991-aacb-4b69-91ec-05c06f148a2b admin admin] Request method failure captured: Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept: application/json Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Accept-Encoding: gzip, deflate Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Connection: keep-alive Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Content-Length: 0 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Host: 10.222.0.57 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-Api-Version: compute 2.90 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Openstack-System-Scope: None Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: User-Agent: python-novaclient Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Auth-Token: gAAAAABi8T-NcY-7YKCb1F8xdt95quVC9aNpFJudAjxb1dvjxdUbpGzTGRD6MngnKEIX0k6vEHwBHow3KLHVry33SUPKdXtBN6aVcg4zLwSvhDmAZOmnK3-JGxJivKH7QcB8dmHsiyXhZkplBUmH33Bjtfz-Mr4JbR4w2nKX8L3MVxBvh-q-GVM Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Id: None Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Domain-Name: None Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Identity-Status: Confirmed Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Is-Admin-Project: True Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Id: default Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Domain-Name: Default Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Project-Name: admin Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Role: member,admin,reader Aug 08 16:53:34.561444 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Roles: member,admin,reader Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0b6d65db9ee4a2cb85f51ab2f1fbc92", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0b6d65db9ee4a2cb85f51ab2f1fbc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant: admin Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Id: c0b6d65db9ee4a2cb85f51ab2f1fbc92 Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-Tenant-Name: admin Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User: admin Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Id: default Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Domain-Name: Default Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Id: 8502ad6c48f34f22831d3b9a1d5e8e5d Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: X-User-Name: admin Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: method: > Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: exception: Flavor 451 could not be found. Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: action_args: {'id': '451'} Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:34.563347 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:34.564210 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: ERROR nova.api.openstack.wsgi Aug 08 16:53:34.565530 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-972a3991-aacb-4b69-91ec-05c06f148a2b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:34.566906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-972a3991-aacb-4b69-91ec-05c06f148a2b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013353 Aug 08 16:53:34.566906 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:53:35.585752 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:35.587376 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Aug 08 16:53:35.588156 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:36.196180 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-28b5c643-e48e-47a1-b95f-3866a0f6def3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:36.298125 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-28b5c643-e48e-47a1-b95f-3866a0f6def3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.569379 Aug 08 16:53:36.298720 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Aug 8 16:53:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:37.522956 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:37.524003 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 08 16:53:37.524414 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:38.147093 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-e273a550-895c-45e8-8f8d-63859ae35d65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:38.230998 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-e273a550-895c-45e8-8f8d-63859ae35d65 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.565680 Aug 08 16:53:38.231564 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Aug 8 16:53:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:39.260204 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:39.261314 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 08 16:53:39.261713 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:39.908557 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-add0d951-4c59-445e-a044-4d3dcb511ea8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:40.043557 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-add0d951-4c59-445e-a044-4d3dcb511ea8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.639602 Aug 08 16:53:40.044120 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Aug 8 16:53:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:41.074430 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:41.075549 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 08 16:53:41.076158 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:41.625420 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-d72c7b68-6191-4a6d-b4d3-096a2954206f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:41.876694 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-d72c7b68-6191-4a6d-b4d3-096a2954206f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.661039 Aug 08 16:53:41.877255 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Aug 8 16:53:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:53:42.897833 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:42.898853 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 08 16:53:42.899246 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:43.597724 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-6cbc55cc-45a9-4fe6-a9ea-cb0198d6df35 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:43.627404 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-6cbc55cc-45a9-4fe6-a9ea-cb0198d6df35 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.587967 Aug 08 16:53:43.627982 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Mon Aug 8 16:53:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:37.537501 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:37.539205 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-f5ce550e-48ec-4266-82b6-9acc77ea14e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001840 Aug 08 16:54:37.539916 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Mon Aug 8 16:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:37.554384 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:38.030941 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-2c6ab8c3-4bf7-49a1-9bab-9cc445f53aab admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.052419 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-2c6ab8c3-4bf7-49a1-9bab-9cc445f53aab admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.502797 Aug 08 16:54:38.052978 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Aug 8 16:54:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:38.079977 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG dbcounter [-] [115513] Writing DB stats nova_api:SELECT=14 {{(pid=115513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:38.084902 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-a7ba7786-8c4a-41c1-aef5-e47eb3702ea3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.096330 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-a7ba7786-8c4a-41c1-aef5-e47eb3702ea3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015681 Aug 08 16:54:38.096330 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:38.107500 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-1c67dc75-4d28-4666-8cae-67ea758a2ead admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.115619 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-1c67dc75-4d28-4666-8cae-67ea758a2ead admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012111 Aug 08 16:54:38.116156 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:38.130991 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.139325 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012173 Aug 08 16:54:38.139862 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:38.152217 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-cfb0d779-1a3d-4c48-b30a-190e979d66bc admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.160537 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-cfb0d779-1a3d-4c48-b30a-190e979d66bc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012364 Aug 08 16:54:38.161073 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:51.578254 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.579268 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 08 16:57:51.579723 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:51.728333 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:SELECT=6 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:51.902034 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.906187 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:57:51.906187 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:57:51.908254 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.909151 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.910000 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.910945 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.911405 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.911831 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.950388 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-0fb4bc20-bb47-478b-93bb-0d6aec686199 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.223298 Aug 08 16:57:51.950989 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:57:52.817133 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:52.818228 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 08 16:57:52.818691 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:53.022466 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:53.025491 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:57:53.025491 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:57:53.026690 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.027137 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.027573 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.028341 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.028737 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.029145 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.048353 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-ab6f6b89-3716-4be2-bd3c-40055c90f33c admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088110 Aug 08 16:57:53.048929 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:57:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:58:04.319043 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.319548 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 08 16:58:04.319932 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:04.465110 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell0:SELECT=4 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:04.465110 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell1:SELECT=4 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:04.475535 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:SELECT=8 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:04.526635 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.529129 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:58:04.529129 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:58:04.530303 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.530780 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.531205 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.531916 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.532353 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.532768 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.552887 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-6e7b1e67-87a9-402a-8853-78cd94cb7cf0 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093645 Aug 08 16:58:04.553456 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:58:05.408461 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.409958 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 08 16:58:05.410667 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:05.612350 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.614701 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:58:05.614701 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:58:05.615803 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.616281 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.616709 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.617418 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.617946 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.618365 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.643644 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-94abfc13-d631-44f2-9b71-684b3620050c admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090234 Aug 08 16:58:05.644213 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:16.900601 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:16.901605 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 08 16:58:16.902025 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 38/77] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:17.046422 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell0:SELECT=4 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:17.047173 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_cell1:SELECT=4 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:17.047805 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG dbcounter [-] [115512] Writing DB stats nova_api:SELECT=8 {{(pid=115512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:17.099115 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:17.101523 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:58:17.101523 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:58:17.102651 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:17.103167 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:17.103594 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:17.104303 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:17.104742 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:17.105154 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:17.128118 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-c91a9c34-0ac1-4530-aa22-57365e681281 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086154 Aug 08 16:58:17.128598 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 40/78] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:58:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:17.961641 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: DEBUG nova.api.openstack.wsgi [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] Calling method '>' {{(pid=115513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:17.962668 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: INFO nova.api.openstack.requestlog [None req-be1bc771-4c73-4043-bef6-1a25d019b1e3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 Aug 08 16:58:17.963056 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: [pid: 115513|app: 0|req: 39/79] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Aug 8 16:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:18.156362 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG nova.api.openstack.wsgi [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Calling method '>' {{(pid=115512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:18.159132 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:58:18.159132 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: warnings.warn(msg) Aug 08 16:58:18.160260 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:18.160736 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:18.161204 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:18.161947 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:18.162395 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:18.162808 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: DEBUG oslo_concurrency.lockutils [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:18.185374 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: INFO nova.api.openstack.requestlog [None req-5ee828cf-9cae-48ca-9133-f3df14bc6c46 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084001 Aug 08 16:58:18.185879 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: [pid: 115512|app: 0|req: 41/80] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Aug 8 16:58:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:20.827250 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: Mon Aug 8 16:59:20 2022 - graceful shutdown triggered... Aug 08 16:59:20.827589 dv-cinder-852210-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 16:59:20.828328 dv-cinder-852210-3-iscsi devstack@n-api.service[115512]: Gracefully killing worker 1 (pid: 115512)... Aug 08 16:59:20.828714 dv-cinder-852210-3-iscsi devstack@n-api.service[115513]: Gracefully killing worker 2 (pid: 115513)... Aug 08 16:59:21.829095 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: worker 1 buried after 1 seconds Aug 08 16:59:21.829687 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: worker 2 buried after 1 seconds Aug 08 16:59:21.829687 dv-cinder-852210-3-iscsi devstack@n-api.service[115511]: goodbye to uWSGI. Aug 08 16:59:21.830828 dv-cinder-852210-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 16:59:21.831367 dv-cinder-852210-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 16:59:21.834148 dv-cinder-852210-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 16:59:21.846002 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 16:59:21 2022] *** Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: nodename: dv-cinder-852210-3-iscsi Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: machine: x86_64 Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: clock source: unix Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: pcre jit disabled Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: detected number of CPU cores: 4 Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: current working directory: / Aug 08 16:59:21.847958 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: detected binary path: /usr/bin/uwsgi-core Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: your processes number limit is 47680 Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: your memory page size is 4096 bytes Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: detected max file descriptor number: 2048 Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: lock engine: pthread robust mutexes Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: thunder lock: enabled Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 16:59:21.848711 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 16:59:21.889270 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: Python main interpreter initialized at 0x563767edb9c0 Aug 08 16:59:21.889270 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: python threads support enabled Aug 08 16:59:21.889270 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: your server socket listen backlog is limited to 100 connections Aug 08 16:59:21.889270 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: your mercy for graceful operations on workers is 90 seconds Aug 08 16:59:21.889722 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 16:59:21.889722 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: *** Operational MODE: preforking *** Aug 08 16:59:21.890010 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: *** uWSGI is running in multiple interpreter mode *** Aug 08 16:59:21.890010 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: spawned uWSGI master process (pid: 130490) Aug 08 16:59:21.890674 dv-cinder-852210-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 16:59:21.890921 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: spawned uWSGI worker 1 (pid: 130500, cores: 1) Aug 08 16:59:21.891167 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: spawned uWSGI worker 2 (pid: 130501, cores: 1) Aug 08 16:59:21.891406 dv-cinder-852210-3-iscsi devstack@n-api.service[130490]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 16:59:22.570051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:59:22.573525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:59:23.740151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:59:23.740151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: from cryptography.utils import int_from_bytes Aug 08 16:59:23.740806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:59:23.740806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: from cryptography.utils import int_from_bytes Aug 08 16:59:23.750346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:59:23.750346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: from cryptography.utils import int_from_bytes Aug 08 16:59:23.751099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:59:23.751099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: from cryptography.utils import int_from_bytes Aug 08 16:59:26.108140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:59:26.108688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:59:26.108940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:59:26.109310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:59:26.109575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:59:26.110008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.110346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.110676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.111003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.111341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.111476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:59:26.111850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.111927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:59:26.112003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.112285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:59:26.112379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.112616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.112705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:59:26.112887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.112974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:59:26.113210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.113305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.113540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-3-iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.113623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.113899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.114961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.115955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.116124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.116301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.116427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.116725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-3-iscsi {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.116840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.117047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.117152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.117887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.118080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.118204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.118521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.118744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.118895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.119977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.120156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.120325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.120478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.120635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.120893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-3-iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.121875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.122876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-3-iscsi {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.123970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.124121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.124291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.124465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.124938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.124938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.125411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.125590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.125751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.126995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.127160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.127325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.127492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.127850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.128976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.129950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.130894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.131892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.132970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.133701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.133877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.134993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.135966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.136890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.137049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.137206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.137358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.137522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.137878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.138900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.139969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.140905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.141050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.141200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.141636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.141825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.141988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.142932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.143090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.143262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.143420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.143574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.143859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.144919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.145851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.146940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.147094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.147294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.147451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.147707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.147910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.148964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.149773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.153207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.153469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.153627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.153805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.153969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.154128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.154274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.154500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.154664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.154891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.155054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.155200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.155344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.155518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.155663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.156840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.157920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.158964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.159908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.159993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.160087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.160242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.160426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.160612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:59:26.160807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.160984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.161997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.162973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.163971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.164947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.165987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.166990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.167103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.167421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.167552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.167741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.167861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.168822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.169887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.170336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.170496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.170658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.170814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.170965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.171933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.172087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.172252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.172412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.172811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.172963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.173955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.174942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.175930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.176309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.176485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.176647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.176805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.176959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.177110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.177341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.177504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.177664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.177877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.178761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.179062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.179062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.179403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.179403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.179702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.180344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.180511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.180663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.180823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.180978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.181967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.182914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.183075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.183229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.183379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.183579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.183850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.184961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.185926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.194864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.195025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.195186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.195339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.195500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.196290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.196450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.196603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.196776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.197900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.198862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.199939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.200992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.201710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.202997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.203966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.204943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.205934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.206944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.207982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.208923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.209138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.209282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.209497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.209669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.209847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.210959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.211963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.212961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.213034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.213104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.213344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.213656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.213934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.214131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.214257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.214359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.215141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.216235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.217236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.217951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.218936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.219940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.220962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.221258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.221374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.221581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.221692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.222976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.223992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.224996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.225947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.227812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.227910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.227992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.228930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.229980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.230852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.231950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.232968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.233949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.234963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.235839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.236843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.237963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.238960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.239910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.240126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.240214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.240444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.241520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.241520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.241706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.241843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.241938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.242017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.242095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.242167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.242249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.242818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.243810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.244943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.245891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.246000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.247739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.247965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.248999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.249952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.250812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.251753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.252473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.252662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.252847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.253035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.253236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.253444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.253665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.253898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.254985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.255119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.255253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.255390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.255390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.255887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.256937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.257902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.262936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.263942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.264887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.265983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.266967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.267873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.268972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.269926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.270933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.271869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.272814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.273047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.273136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.273505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.273652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.273854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.274035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.274154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.274265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.275935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.276965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.277090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.277329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.277657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.277868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.278925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.279878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.280980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.281113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.281224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.281363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.281598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.281730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.282084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.282446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.282788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.283125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.283447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.283761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.284080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.284392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.284709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.285040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.285355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.285674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.285903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.286962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.287073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.287261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.287400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.287647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.287898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.288983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.289267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.289461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.289593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.289923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.291921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.292964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.293901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.294956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.295099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.295844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.296888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.297053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.297209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.297352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.297972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.298982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.299142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.299369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.299669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.299831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.300980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.301461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.301623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.301952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.302106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.302400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.302558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.302729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.303024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.303179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.303323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.303745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.303910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.304143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.304297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.304456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.304701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.305530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.305781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.305980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.306944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.307136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.307285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.307436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.308307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.308307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.308608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.308773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.308917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.309091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.309242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.309400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.309544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.317261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.317450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.317572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.319789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.319989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.320156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.320156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.320626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.321285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.321449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.321613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.321762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.321945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.322717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.323971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.324173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.324433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.324681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.324969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.324969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.325345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.325529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.325677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.325677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.326942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.327745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.329863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.329863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.330183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.330778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.331033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.331275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.331275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.331724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.331967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.332945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.333916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.334864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.335982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.336177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.336444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.336606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.336762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.336909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.337919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.338078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.338233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.338401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.338925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.339978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.340314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.340469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.340622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.340776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.340930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.341087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.341278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.341447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.341447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.341754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.343121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.343335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.343582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.343813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.344018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.344252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.344500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.344752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.345027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.345493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.345756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.346014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.346230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.346436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.346768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.347040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.347295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.347535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.347755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.348001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.348276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.348498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.348685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.349952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.350207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.350389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.350560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.350560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.350943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.351134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.351443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.352404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.352582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.352738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.352911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.353168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.353350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.353521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.353680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.353851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.354940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.355102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.355267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.355549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.355711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.355865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.356075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.356238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.356406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.356581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.356581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.357918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.358848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.359280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.359280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.359604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.359761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.359913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.360883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.361867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.362282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.362600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.362783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.362948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.363111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.363388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.363564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.363729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.363910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.364883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.365038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.365038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.365354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.365542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.365916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.366904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.367194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.367394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.368066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.368225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.368388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.368388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.369643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.369857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.370037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.370203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.370358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.370523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.370870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.371973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.372891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.373746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.377739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.377978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.378985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.379149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.379333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.379802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.379974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.380949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.381104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.381257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.381437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.381710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.381977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.382137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.382297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.382453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.382606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.382785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.383077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.383287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.383468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.383468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.383890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.384857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.385669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.386174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.386352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.386509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.386685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.386685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.387185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.387370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.387370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.387682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.387980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.388957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.389119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.389284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.389445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.389941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.390691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.391137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.391293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.391468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.391640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.391803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.392715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.393394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.393559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.393750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.394935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.395889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.396854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.397160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.397489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.397660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.397854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.398943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.399231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.399469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.399775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.400494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.400740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.401000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.401247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.401497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.401733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.401973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.402961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.403133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.403435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.403595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.403759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.403759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.404203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.404407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.405030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.405207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.405372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.405528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.406581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.406799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.406959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.407116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.407280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.407468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.407798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.407968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.408126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.408296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.408461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.408626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.408817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.409144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.409304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.409500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.409677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.409677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.410630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.410810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.410968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.411979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.412751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.413802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.418796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.420246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.422041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.422041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:59:26.422041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:59:26.549018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO dbcounter [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Registered counter for database nova_api Aug 08 16:59:26.559550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO dbcounter [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Registered counter for database nova_api Aug 08 16:59:26.571665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.579916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writer thread running {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.581934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_db.sqlalchemy.engines [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.599051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writer thread running {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.637748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.context [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3cbdaf28-93b6-4787-a2ab-078d88b45544(cell1) {{(pid=130500) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:59:26.641964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.642445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.644009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.644756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.645202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.647250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.649518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO dbcounter [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Registered counter for database nova_cell0 Aug 08 16:59:26.653988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO dbcounter [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Registered counter for database nova_cell1 Aug 08 16:59:26.656894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.context [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3cbdaf28-93b6-4787-a2ab-078d88b45544(cell1) {{(pid=130501) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:59:26.661104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.661298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.661603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.662702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.663247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.664016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.665013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.667089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.669228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO dbcounter [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Registered counter for database nova_cell0 Aug 08 16:59:26.670215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writer thread running {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.671541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writer thread running {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.673849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO dbcounter [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Registered counter for database nova_cell1 Aug 08 16:59:26.681713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_db.sqlalchemy.engines [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.683698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_db.sqlalchemy.engines [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.689350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writer thread running {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.691812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writer thread running {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.818005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO dbcounter [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Registered counter for database nova_cell0 Aug 08 16:59:26.825167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.829886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writer thread running {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:26.839307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO dbcounter [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Registered counter for database nova_cell0 Aug 08 16:59:26.847955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_db.sqlalchemy.engines [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:59:26.853811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writer thread running {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:59:27.156040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: WARNING keystonemiddleware.auth_token [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:59:27.163296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: WARNING keystonemiddleware.auth_token [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:59:27.175554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: WARNING keystonemiddleware.auth_token [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:59:27.182974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: WARNING keystonemiddleware.auth_token [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:59:27.512965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: WARNING keystonemiddleware.auth_token [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:59:27.519823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: WARNING keystonemiddleware.auth_token [None req-b6b54a54-e596-4fa8-bc9f-45a42f895a2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:59:27.527181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563767edb9c0 pid: 130500 (default app) Aug 08 16:59:27.534411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: WARNING keystonemiddleware.auth_token [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:59:27.541212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: WARNING keystonemiddleware.auth_token [None req-cedc311e-cc44-4fc1-9afc-a64a51cdecce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:59:27.547900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563767edb9c0 pid: 130501 (default app) Aug 08 17:00:04.475621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=3 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:04.476552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=3 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:04.477470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=3 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:04.478283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=3 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:05.502154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:05.505423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:05.507068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:05.508285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:05.945499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3500d0d5-2d51-4b0e-83d4-4ebd2267cba5 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Action: 'create', calling method: .version_select at 0x7f743a869dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1500870022", "metadata": {"Type": "work"}}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:06.649025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8e0eeac-0c86-4e17-8095-70236f6c245a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Action: 'create', calling method: .version_select at 0x7f743a869dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1752137813"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:08.823588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3500d0d5-2d51-4b0e-83d4-4ebd2267cba5 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.360816 Aug 08 17:00:08.833314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Aug 8 17:00:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4372 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 17:00:08.839416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8793ed04-d929-439e-aa5e-ec602431963c tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a759c10>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:09.070655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8e0eeac-0c86-4e17-8095-70236f6c245a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.577589 Aug 08 17:00:09.071684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Aug 8 17:00:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3582 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 17:00:09.090768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7de93531-46d0-4e6a-9afd-b7d0b3c7763c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a755c10>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:09.134196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8793ed04-d929-439e-aa5e-ec602431963c tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.299261 Aug 08 17:00:09.134947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:08 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:09.374184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7de93531-46d0-4e6a-9afd-b7d0b3c7763c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 200 len: 345 microversion: 2.1 time: 0.290194 Aug 08 17:00:09.375593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:09 2022] GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:10.155529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bdc13498-6e37-4848-9dab-5afd74206914 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a6f8310>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:10.398004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ee3ece4-aec5-41ba-9494-3e4aa76975d1 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f5310>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:10.629022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bdc13498-6e37-4848-9dab-5afd74206914 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.477944 Aug 08 17:00:10.637935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:10 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:10.659938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ee3ece4-aec5-41ba-9494-3e4aa76975d1 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 200 len: 346 microversion: 2.1 time: 0.273829 Aug 08 17:00:10.660971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:10 2022] GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:10.676308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-666e1300-bb55-4d1c-9339-e8d2740228dc tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Action: 'create', calling method: .version_select at 0x7f743a6f8940>, body: {"snapshot": {"volume_id": "27370b19-fd76-4af5-8ec8-35d43f1bd289", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1908597210"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:11.650027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ac57839-86af-47c0-9cec-ce5f919e87e8 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a6f59d0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:11.658034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-666e1300-bb55-4d1c-9339-e8d2740228dc tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.984395 Aug 08 17:00:11.658034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 4/7] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Aug 8 17:00:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:11.668494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c65ae834-5f1a-409d-93a7-89e6e7b91ba9 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f8c10>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:11.796705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ac57839-86af-47c0-9cec-ce5f919e87e8 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 354 microversion: 2.1 time: 0.156054 Aug 08 17:00:11.799624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:11 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:11.819501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5f0043c1-437f-40c0-b2e9-a8b956d709cc tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a755ca0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:11.840578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c65ae834-5f1a-409d-93a7-89e6e7b91ba9 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 287 microversion: 2.1 time: 0.176931 Aug 08 17:00:11.844079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:11 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:11.853416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c84f1d30-ca28-40ed-8ca8-f3d2fab5c906 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f84c0>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:12.053212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5f0043c1-437f-40c0-b2e9-a8b956d709cc tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 354 microversion: 2.1 time: 0.244197 Aug 08 17:00:12.054168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:11 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:12.073405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-deae4b27-8d81-40ac-8bcc-b811dca3f1fe tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a6f5940>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:12.190211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c84f1d30-ca28-40ed-8ca8-f3d2fab5c906 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.341758 Aug 08 17:00:12.192361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1140 bytes} [Mon Aug 8 17:00:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:12.208881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-161b36fb-9fd2-46ef-b4f6-56643daa8822 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6fd5e0>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:12.446847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-161b36fb-9fd2-46ef-b4f6-56643daa8822 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 287 microversion: 2.1 time: 0.243264 Aug 08 17:00:12.447816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:12 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 287 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:12.540356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-deae4b27-8d81-40ac-8bcc-b811dca3f1fe tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 202 len: 0 microversion: 2.1 time: 0.471807 Aug 08 17:00:12.541840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:00:12 2022] DELETE /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:00:12.549637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9f76bbdf-959f-42ec-b630-ed65e78f0db5 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a759c10>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:12.637600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9f76bbdf-959f-42ec-b630-ed65e78f0db5 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.091777 Aug 08 17:00:12.639030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:12 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:13.466400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1159609d-4756-46a6-814d-adcbd196afad tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f5280>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:13.559347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1159609d-4756-46a6-814d-adcbd196afad tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 287 microversion: 2.1 time: 0.102251 Aug 08 17:00:13.565235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:13 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:13.652498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87ed5443-ac15-430c-a832-3f453e67f021 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a6f8280>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:13.769486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87ed5443-ac15-430c-a832-3f453e67f021 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.121334 Aug 08 17:00:13.771412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:13 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:14.577117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-acb7bdbe-4702-4505-813b-4f4f72a8ee5b tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f50d0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:14.663777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-acb7bdbe-4702-4505-813b-4f4f72a8ee5b tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 287 microversion: 2.1 time: 0.090350 Aug 08 17:00:14.664358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:14 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:14.787894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-af001f41-3bbb-4de0-969a-5b49f59e6d08 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a6f8a60>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:14.876901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-af001f41-3bbb-4de0-969a-5b49f59e6d08 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.094058 Aug 08 17:00:14.877832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:14 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:15.681991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9040cd84-198c-4bed-af51-f255daf07157 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f58b0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:15.757472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9040cd84-198c-4bed-af51-f255daf07157 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 288 microversion: 2.1 time: 0.084804 Aug 08 17:00:15.764294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 9/19] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:15 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:15.770192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3244650-41f5-47be-918b-e474e7b4c356 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a759ca0>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:15.891721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f62cb66f-c4bc-4a84-8bbc-d5c94ef5ecff tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a755c10>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:15.960022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3244650-41f5-47be-918b-e474e7b4c356 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 202 len: 0 microversion: 2.1 time: 0.194552 Aug 08 17:00:15.960810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 11/20] 10.222.0.57 () {58 vars in 1254 bytes} [Mon Aug 8 17:00:15 2022] DELETE /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:00:15.970127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fcc0ef0c-977b-48c4-a842-0f954721d808 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f8c10>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:16.010425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f62cb66f-c4bc-4a84-8bbc-d5c94ef5ecff tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 200 len: 353 microversion: 2.1 time: 0.123031 Aug 08 17:00:16.018265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 10/21] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:15 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:16.041531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fcc0ef0c-977b-48c4-a842-0f954721d808 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 200 len: 287 microversion: 2.1 time: 0.075517 Aug 08 17:00:16.042550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 12/22] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:15 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:17.027375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb6e4563-0f01-452a-ae57-df9fb122e518 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Calling method '.version_select at 0x7f743a755ca0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:17.058807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f70629a-56ac-4a6e-965f-69e1a3dcbdc0 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6f8280>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:17.139224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-8f70629a-56ac-4a6e-965f-69e1a3dcbdc0 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] HTTP exception thrown: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f70629a-56ac-4a6e-965f-69e1a3dcbdc0 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Request method failure captured: Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 HTTP/1.1 Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEVLB7S-Ell-OtkSCbUPo5MKChJGxEue6O-6xDZk-8_uEk--RtUpXdGhjgBkmB3S1HJPPQb0B0xO4C18AjxMdSeFbeIv3mC8iG6P8H8MbBITrYY-Hj6fID3q0iUY_SOxcfbtn1sP_hhDHiq8nn62PmJMbZIpR991Pn1f-3s5dHAPWA Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:00:17.143246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9a1e963209924abb967428435401540a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9a1e963209924abb967428435401540a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: 4bbd40052949468a897744a3010f337c Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': '8f045792-f5a1-44a4-909c-3f4490e4dbe7'} Aug 08 17:00:17.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. (HTTP 404) (Request-ID: req-1e2d1d6c-73f7-41db-8b32-1dc342a65cb5) Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.145877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:17.146805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 17:00:17.148418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. Aug 08 17:00:17.149646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.153027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-cb6e4563-0f01-452a-ae57-df9fb122e518 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] HTTP exception thrown: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb6e4563-0f01-452a-ae57-df9fb122e518 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Request method failure captured: Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f HTTP/1.1 Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEUeRSknfXPfrpsRIDopD_tuFX0lpRK3nooAdUOxrqgff3-kHvg7aiquy4bn2Tb4NRlsocMfzAS_tSwxCedc7Lbzarwcaar2lmTb8DzfKitzdj49MJYcMGHCfzZoQqKbjj_Z6fm9kb42Dnk7Bh-C9bwQ30rDpdWidM105r4oo7LU5c Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: a326b1ccd4d3402d9abdd4dcbf6e3f2c Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesGetTestJSON-1963633236 Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:17.157477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a326b1ccd4d3402d9abdd4dcbf6e3f2c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a326b1ccd4d3402d9abdd4dcbf6e3f2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a326b1ccd4d3402d9abdd4dcbf6e3f2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a326b1ccd4d3402d9abdd4dcbf6e3f2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesGetTestJSON-1963633236 Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: a326b1ccd4d3402d9abdd4dcbf6e3f2c Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesGetTestJSON-1963633236 Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesGetTestJSON-1963633236-project Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 7127a5d0909a49b9b8ee4c472ac28012 Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesGetTestJSON-1963633236-project Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '5ec19aed-6e02-4e48-a52b-faf77201140f'} Aug 08 17:00:17.158761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. (HTTP 404) (Request-ID: req-844e5b9e-8fa0-4e24-af1a-bc3e5ffbc56e) Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.159518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:17.160519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 17:00:17.161574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. Aug 08 17:00:17.162910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:17.164756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb6e4563-0f01-452a-ae57-df9fb122e518 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] Returning 404 to user: Volume 5ec19aed-6e02-4e48-a52b-faf77201140f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:17.165929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb6e4563-0f01-452a-ae57-df9fb122e518 tempest-VolumesGetTestJSON-1963633236 tempest-VolumesGetTestJSON-1963633236-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f" status: 404 len: 109 microversion: 2.1 time: 0.144314 Aug 08 17:00:17.166379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f70629a-56ac-4a6e-965f-69e1a3dcbdc0 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Returning 404 to user: Snapshot 8f045792-f5a1-44a4-909c-3f4490e4dbe7 could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:17.167078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:17 2022] GET /compute/v2.1/os-volumes/5ec19aed-6e02-4e48-a52b-faf77201140f => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:17.169370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8f70629a-56ac-4a6e-965f-69e1a3dcbdc0 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7" status: 404 len: 111 microversion: 2.1 time: 0.116891 Aug 08 17:00:17.172223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 13/24] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Aug 8 17:00:17 2022] GET /compute/v2.1/os-snapshots/8f045792-f5a1-44a4-909c-3f4490e4dbe7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:17.189269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53e96c2d-7da6-4ba9-9519-52c3388e15c6 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743b06c280>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:17.485996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53e96c2d-7da6-4ba9-9519-52c3388e15c6 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 202 len: 0 microversion: 2.1 time: 0.298733 Aug 08 17:00:17.485996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:00:17 2022] DELETE /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:00:17.491937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-479523ab-c352-4552-ba2d-e55f50a146d7 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6fd550>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:17.613089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-479523ab-c352-4552-ba2d-e55f50a146d7 tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 200 len: 345 microversion: 2.1 time: 0.124916 Aug 08 17:00:17.614332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 14/26] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:17 2022] GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:18.628378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e00ab697-0c0f-4748-bf6f-611db0e9aebd tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a869d30>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:18.745432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-e00ab697-0c0f-4748-bf6f-611db0e9aebd tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] HTTP exception thrown: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e00ab697-0c0f-4748-bf6f-611db0e9aebd tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Request method failure captured: Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 HTTP/1.1 Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEVLB7S-Ell-OtkSCbUPo5MKChJGxEue6O-6xDZk-8_uEk--RtUpXdGhjgBkmB3S1HJPPQb0B0xO4C18AjxMdSeFbeIv3mC8iG6P8H8MbBITrYY-Hj6fID3q0iUY_SOxcfbtn1sP_hhDHiq8nn62PmJMbZIpR991Pn1f-3s5dHAPWA Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:18.749193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9a1e963209924abb967428435401540a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9a1e963209924abb967428435401540a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 4bbd40052949468a897744a3010f337c Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '27370b19-fd76-4af5-8ec8-35d43f1bd289'} Aug 08 17:00:18.750233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. (HTTP 404) (Request-ID: req-fef92800-73b9-4b8d-b4cc-97c8fa33a491) Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.750855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:18.751700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 17:00:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e00ab697-0c0f-4748-bf6f-611db0e9aebd tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Returning 404 to user: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e00ab697-0c0f-4748-bf6f-611db0e9aebd tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 404 len: 109 microversion: 2.1 time: 0.127265 Aug 08 17:00:18.757944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:18 2022] GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:18.776571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7884756-346d-4909-9060-cf5527760d6a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6fdc10>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:18.850344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-c7884756-346d-4909-9060-cf5527760d6a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] HTTP exception thrown: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7884756-346d-4909-9060-cf5527760d6a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Request method failure captured: Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 HTTP/1.1 Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEVLB7S-Ell-OtkSCbUPo5MKChJGxEue6O-6xDZk-8_uEk--RtUpXdGhjgBkmB3S1HJPPQb0B0xO4C18AjxMdSeFbeIv3mC8iG6P8H8MbBITrYY-Hj6fID3q0iUY_SOxcfbtn1sP_hhDHiq8nn62PmJMbZIpR991Pn1f-3s5dHAPWA Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:00:18.853359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9a1e963209924abb967428435401540a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9a1e963209924abb967428435401540a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: 4bbd40052949468a897744a3010f337c Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': '27370b19-fd76-4af5-8ec8-35d43f1bd289'} Aug 08 17:00:18.854491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. (HTTP 404) (Request-ID: req-7a5dbdaf-8243-4edd-8da2-b8c94caa03c4) Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.855172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:18.856201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 17:00:18.857272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.859443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7884756-346d-4909-9060-cf5527760d6a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Returning 404 to user: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:18.860472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7884756-346d-4909-9060-cf5527760d6a tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 404 len: 109 microversion: 2.1 time: 0.097744 Aug 08 17:00:18.861140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:00:18 2022] DELETE /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:18.871283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51584e61-f214-4bb9-8bd2-b80a09f80f5c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Calling method '.version_select at 0x7f743a6fd670>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:18.929717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-51584e61-f214-4bb9-8bd2-b80a09f80f5c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] HTTP exception thrown: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51584e61-f214-4bb9-8bd2-b80a09f80f5c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Request method failure captured: Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 HTTP/1.1 Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEVLB7S-Ell-OtkSCbUPo5MKChJGxEue6O-6xDZk-8_uEk--RtUpXdGhjgBkmB3S1HJPPQb0B0xO4C18AjxMdSeFbeIv3mC8iG6P8H8MbBITrYY-Hj6fID3q0iUY_SOxcfbtn1sP_hhDHiq8nn62PmJMbZIpR991Pn1f-3s5dHAPWA Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:00:18.932527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9a1e963209924abb967428435401540a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9a1e963209924abb967428435401540a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9a1e963209924abb967428435401540a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 9a1e963209924abb967428435401540a Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-814982355 Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: 4bbd40052949468a897744a3010f337c Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesSnapshotsTestJSON-814982355-project Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': '27370b19-fd76-4af5-8ec8-35d43f1bd289'} Aug 08 17:00:18.934003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. (HTTP 404) (Request-ID: req-5b374547-a1a7-4772-ad23-a3f99057771a) Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.934709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:18.935741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 17:00:18.936761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. Aug 08 17:00:18.937747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:18.938551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51584e61-f214-4bb9-8bd2-b80a09f80f5c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] Returning 404 to user: Volume 27370b19-fd76-4af5-8ec8-35d43f1bd289 could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:18.939787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-51584e61-f214-4bb9-8bd2-b80a09f80f5c tempest-VolumesSnapshotsTestJSON-814982355 tempest-VolumesSnapshotsTestJSON-814982355-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289" status: 404 len: 109 microversion: 2.1 time: 0.073899 Aug 08 17:00:18.940759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 16/29] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:18 2022] GET /compute/v2.1/os-volumes/27370b19-fd76-4af5-8ec8-35d43f1bd289 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:00:19.541959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-980016258", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "networks": [{"uuid": "838efc26-a9d5-42b7-b293-e56ba2f1acc9"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:19.785179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] validate_networks() for [('838efc26-a9d5-42b7-b293-e56ba2f1acc9', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:00:21.200672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-81fb3874-928a-4999-a3c1-6e3581a3f258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'create', calling method: .version_select at 0x7f743a759a60>, body: {"keypair": {"name": "tempest-keypair-327296368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3iDUGOQaFOoTUvpR3wyzdx2gzTozx1PJt95nGiAQ7KGRCNN0nxZyoSPzaZhDS4zSurxHZ9u2mTrCZ8ji1uUUc+qeqM3EuS+i7JV4iQY4JDN9cBUQcdf8x4dv3DmHiD/A=="}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:21.400833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-81fb3874-928a-4999-a3c1-6e3581a3f258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:00:21.432972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-81fb3874-928a-4999-a3c1-6e3581a3f258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for user 60dc4976d686449f80d3bfad387a2406 and project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:00:21.615781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-81fb3874-928a-4999-a3c1-6e3581a3f258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.898315 Aug 08 17:00:21.618612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 17/30] 10.222.0.57 () {62 vars in 1200 bytes} [Mon Aug 8 17:00:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 901 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 17:00:22.529259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1202186253", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:22.708228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.network.neutron [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] validate_networks() for [('bddc292a-97ef-4b98-ab3c-917361883f99', None, None, None, None, None)] {{(pid=130500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:00:23.993540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:00:23.994169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:00:23.994602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:00:23.995075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:00:23.995546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:00:24.012481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.013070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.013750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.014699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.015460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.016075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.090547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Getting quotas for project db9c728a8d56493db7bde4b0bc36f550. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:00:24.099155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Getting quotas for user ae31b2903c8e458ca7c68082572db8f4 and project db9c728a8d56493db7bde4b0bc36f550. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:00:24.112105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:00:24.115276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:00:24.370961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9abfa823-de52-4865-8a8a-ea35f9d30f38 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.523602 Aug 08 17:00:24.371802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 14/31] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 5525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:00:24.384267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-97dba0a9-1dbf-4cab-8f6e-610d230a0795 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:24.384886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-97dba0a9-1dbf-4cab-8f6e-610d230a0795 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:24.655268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-97dba0a9-1dbf-4cab-8f6e-610d230a0795 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:24.697493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-97dba0a9-1dbf-4cab-8f6e-610d230a0795 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1214 microversion: 2.1 time: 0.317362 Aug 08 17:00:24.698281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 15/32] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:24 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1214 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:25.106050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:00:25.106695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:00:25.107331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:00:25.107751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:00:25.108328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:00:25.121205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.123439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.123439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.123439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.123973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.124723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.162485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:00:25.169026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for user d6e9bd6db85b4decbdac1908912d158c and project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:00:25.182558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Going to run 1 instances... {{(pid=130500) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:00:25.186474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:00:25.400073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-887f26b9-be28-496c-933a-01cff11af9ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.780529 Aug 08 17:00:25.401658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 18/33] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:00:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:00:25.414635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59087535-e103-4710-8ab9-dd899dedeea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:25.415378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59087535-e103-4710-8ab9-dd899dedeea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:25.536325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59087535-e103-4710-8ab9-dd899dedeea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:25.546991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59087535-e103-4710-8ab9-dd899dedeea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1222 microversion: 2.1 time: 0.137135 Aug 08 17:00:25.548343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 16/34] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:25 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:25.732252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b3a3325a-d9c6-4b24-a446-2deae495f1e3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:25.733640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b3a3325a-d9c6-4b24-a446-2deae495f1e3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:25.991171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b3a3325a-d9c6-4b24-a446-2deae495f1e3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:26.041222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b3a3325a-d9c6-4b24-a446-2deae495f1e3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1214 microversion: 2.1 time: 0.325702 Aug 08 17:00:26.042519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 19/35] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:25 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:26.096005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1703063239", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:26.220759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] validate_networks() for [('bddc292a-97ef-4b98-ab3c-917361883f99', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:00:26.433978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-989641091", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d971e3f8-836d-443a-bcd9-4128537cfc03"}], "security_groups": [{"name": "tempest-securitygroup--1245617014"}], "key_name": "tempest-keypair-327296368", "user_data": "}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:26.734743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.network.neutron [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] validate_networks() for [('d971e3f8-836d-443a-bcd9-4128537cfc03', None, None, None, None, None)] {{(pid=130500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:00:26.945759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:00:26.946337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:00:26.946722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:00:26.947136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:00:26.953182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:00:26.983839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:26.985284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:26.987950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:26.989187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:26.990971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:26.991728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:27.041356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:00:27.048964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for user d6e9bd6db85b4decbdac1908912d158c and project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:00:27.115933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:00:27.115933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:00:27.283042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e674d6ee-8b50-433a-a64e-08e3e31057fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.192761 Aug 08 17:00:27.303441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 17/36] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:00:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:00:27.423970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Flavor limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:00:27.424647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Image limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:00:27.425291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Flavor pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:00:27.425722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Image pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:00:27.426407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:00:27.445603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:27.446485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:27.462427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:27.463942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:27.464750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:27.466068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:27.555750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:00:27.568112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for user 60dc4976d686449f80d3bfad387a2406 and project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:00:27.624866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Going to run 1 instances... {{(pid=130500) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:00:27.638254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:00:27.952752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aca40130-4684-49e4-b5dd-e22ef09f0cc1 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Action: 'create', calling method: .version_select at 0x7f7439d91f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-980243720", "metadata": {"Type": "work"}}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:27.958033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f571f602-f854-4a31-9fa7-22e4035183df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.534037 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aca40130-4684-49e4-b5dd-e22ef09f0cc1 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 121 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:27.961283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-980243720", "metadata": {"Type": "work"}}} Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:27.962851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-980243720', 'metadata': {'Type': 'work'}}}} Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise error Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:27.963559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 17:00:27.964739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 17:00:27.965742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 17:00:27.965742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:27.965742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aca40130-4684-49e4-b5dd-e22ef09f0cc1 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:27.965742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aca40130-4684-49e4-b5dd-e22ef09f0cc1 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.657766 Aug 08 17:00:27.973197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Aug 8 17:00:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:00:27.973446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 20/38] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Aug 8 17:00:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 17:00:27.988978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2fe137a7-7c7f-4a8d-a599-16da5ef86be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:27.989844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2fe137a7-7c7f-4a8d-a599-16da5ef86be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:27.996502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41ff7b0f-74e1-4271-ae3d-c96a0ee43787 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:27.997210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41ff7b0f-74e1-4271-ae3d-c96a0ee43787 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:28.074178 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2fe137a7-7c7f-4a8d-a599-16da5ef86be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.090241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2fe137a7-7c7f-4a8d-a599-16da5ef86be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1222 microversion: 2.1 time: 0.114864 Aug 08 17:00:28.101140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 21/39] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:27 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:28.126418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd232b4a-6a4c-490e-b430-74fe2e5ef741 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Action: 'create', calling method: .version_select at 0x7f743a64d3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1606345376", "metadata": {"Type": "work"}}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd232b4a-6a4c-490e-b430-74fe2e5ef741 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 120 Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:00:28.135440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1606345376", "metadata": {"Type": "work"}}} Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: Aug 08 17:00:28.136661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1606345376', 'metadata': {'Type': 'work'}}}} Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise error Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi '0' Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:28.137357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 17:00:28.138844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 17:00:28.140106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 17:00:28.140106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.141386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd232b4a-6a4c-490e-b430-74fe2e5ef741 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:28.142999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd232b4a-6a4c-490e-b430-74fe2e5ef741 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.049290 Aug 08 17:00:28.144105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 22/40] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Aug 8 17:00:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:00:28.150936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:28.151835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:28.221994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-41ff7b0f-74e1-4271-ae3d-c96a0ee43787 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.232525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41ff7b0f-74e1-4271-ae3d-c96a0ee43787 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1214 microversion: 2.1 time: 0.260929 Aug 08 17:00:28.236507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 19/41] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:27 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:28.242068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-948b9747-ff49-470f-b2e8-b5033f7087b7 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Action: 'create', calling method: .version_select at 0x7f7439d914c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2081868616", "metadata": {"Type": "work"}}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-948b9747-ff49-470f-b2e8-b5033f7087b7 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 119 Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:28.255378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2081868616", "metadata": {"Type": "work"}}} Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:28.256455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2081868616', 'metadata': {'Type': 'work'}}}} Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise error Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi '' Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:28.257190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 17:00:28.258308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 17:00:28.259200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 17:00:28.259200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.288489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-948b9747-ff49-470f-b2e8-b5033f7087b7 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:28.289763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-948b9747-ff49-470f-b2e8-b5033f7087b7 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.051752 Aug 08 17:00:28.297305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 20/42] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Aug 8 17:00:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:00:28.302469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.320698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.325204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa615934-2a15-4f06-bd37-810f7e95d724 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Calling method '.version_select at 0x7f7439d99280>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:28.329035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.337892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6177bc2f-6ce2-4dec-ae99-98b6931af901 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1280 microversion: 2.20 time: 0.188095 Aug 08 17:00:28.338985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 23/43] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:28.367536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-fa615934-2a15-4f06-bd37-810f7e95d724 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] HTTP exception thrown: Volume tempest-invalid-1334798896 could not be found. Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa615934-2a15-4f06-bd37-810f7e95d724 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1334798896 HTTP/1.1 Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:28.369463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Volume tempest-invalid-1334798896 could not be found. Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'tempest-invalid-1334798896'} Aug 08 17:00:28.371152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1334798896 could not be found. (HTTP 404) (Request-ID: req-0263bfac-6fa3-4586-a391-335c8ec2cf02) Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.371907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:28.372852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1334798896 could not be found. Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:28.373832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1334798896 could not be found. Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1334798896 could not be found. Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa615934-2a15-4f06-bd37-810f7e95d724 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 404 to user: Volume tempest-invalid-1334798896 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa615934-2a15-4f06-bd37-810f7e95d724 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1334798896" status: 404 len: 99 microversion: 2.1 time: 0.064488 Aug 08 17:00:28.374983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 21/44] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Aug 8 17:00:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1334798896 => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 17:00:28.383952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-83f6a6f5-1304-4643-b03e-1e588c004793 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004594 Aug 08 17:00:28.384733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 24/45] 10.222.0.57 () {58 vars in 1140 bytes} [Mon Aug 8 17:00:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 17:00:28.393973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1285074b-0e89-42c2-8899-dc4f478f7300 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003856 Aug 08 17:00:28.394798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 22/46] 10.222.0.57 () {58 vars in 1137 bytes} [Mon Aug 8 17:00:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 17:00:28.404486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad716f77-4088-4c6a-9a45-13a4e28e92ed tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Calling method '.version_select at 0x7f7439d27940>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:28.463703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-ad716f77-4088-4c6a-9a45-13a4e28e92ed tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] HTTP exception thrown: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad716f77-4088-4c6a-9a45-13a4e28e92ed tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/os-volumes/59f32bd8-3a6d-4210-aeb9-8647d2cbf589 HTTP/1.1 Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:00:28.466544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': '59f32bd8-3a6d-4210-aeb9-8647d2cbf589'} Aug 08 17:00:28.467562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. (HTTP 404) (Request-ID: req-54899029-8bff-4943-8097-e03285055ebd) Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.468355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 17:00:28.469342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 17:00:28.470292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad716f77-4088-4c6a-9a45-13a4e28e92ed tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 404 to user: Volume 59f32bd8-3a6d-4210-aeb9-8647d2cbf589 could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ad716f77-4088-4c6a-9a45-13a4e28e92ed tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/59f32bd8-3a6d-4210-aeb9-8647d2cbf589" status: 404 len: 109 microversion: 2.1 time: 0.068309 Aug 08 17:00:28.471206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 25/47] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:00:28 2022] DELETE /compute/v2.1/os-volumes/59f32bd8-3a6d-4210-aeb9-8647d2cbf589 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:00:28.481176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-840d3bbf-dd01-4626-990d-d71df9316787 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Calling method '.version_select at 0x7f7439d91550>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:28.517277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-840d3bbf-dd01-4626-990d-d71df9316787 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] HTTP exception thrown: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-840d3bbf-dd01-4626-990d-d71df9316787 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Request method failure captured: Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/os-volumes/a4ef978f-373a-477f-9016-a6703835e91e HTTP/1.1 Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEqxv8LD5Am62ryEJ09eeNRIUasV8VSSQA874CBBzFNMIt6tx9PAs1riIY-14wTGZpxfP6DyyibRAKNB0BAZr-mJuiRCploGlbb4U8Ny_3NOHjijBJxv2EnwlK41MdDG2D4AbGEWm_Npm1y7IOv0cwVX_GPylWqJ1NWtSdE0i0FK_Q Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:00:28.519732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ed2adbf8e814dc2894fe0e8141edd4c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ed2adbf8e814dc2894fe0e8141edd4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 9ed2adbf8e814dc2894fe0e8141edd4c Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesNegativeTest-660078279 Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: c7ff504bc358424c9271f629641b7209 Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesNegativeTest-660078279-project Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'a4ef978f-373a-477f-9016-a6703835e91e'} Aug 08 17:00:28.520821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. (HTTP 404) (Request-ID: req-887b2140-90cb-4a3d-b230-e192e612d52f) Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.521493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 17:00:28.522509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 17:00:28.523402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. Aug 08 17:00:28.524347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:00:28.526443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-840d3bbf-dd01-4626-990d-d71df9316787 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] Returning 404 to user: Volume a4ef978f-373a-477f-9016-a6703835e91e could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:28.538025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-840d3bbf-dd01-4626-990d-d71df9316787 tempest-VolumesNegativeTest-660078279 tempest-VolumesNegativeTest-660078279-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a4ef978f-373a-477f-9016-a6703835e91e" status: 404 len: 109 microversion: 2.1 time: 0.052801 Aug 08 17:00:28.538025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 23/48] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:00:28 2022] GET /compute/v2.1/os-volumes/a4ef978f-373a-477f-9016-a6703835e91e => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:29.113247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:29.116076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:29.123764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.124261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.124941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.125668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.126316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.126923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.257243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:29.257243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:29.272440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.274566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.277177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.278049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.278549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.279000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.430669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.444288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-30251921-079f-4192-b50f-d8bbbc426829 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1226 microversion: 2.1 time: 0.334660 Aug 08 17:00:29.446692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 26/49] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:29 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1226 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:29.452794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:29.453596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:29.521958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.540120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.541290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.542961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.544125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b090487f-914e-4593-88d1-32591ec3e6ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1280 microversion: 2.20 time: 0.096195 Aug 08 17:00:29.544962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 27/50] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:29.556505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6a386c19-f965-418d-8beb-965d5ea90cb9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1218 microversion: 2.1 time: 0.304987 Aug 08 17:00:29.557569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 24/51] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:29 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:30.469971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:30.471921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:30.483360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.483951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.484509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.485239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.485708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.486180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.566362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:30.576731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:30.576731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:30.593252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.594799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.595258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.595984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.599873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.600609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.609747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-656c8a16-2fd8-40ce-9323-bc0ce59588e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1226 microversion: 2.1 time: 0.141144 Aug 08 17:00:30.628687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 28/52] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:30 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:30.637364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:30.638246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:30.647548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.648151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.648740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.649754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.650694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.657115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.724134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:30.748838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:30.751591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:30.753042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-afb95f3b-7a66-47b2-b67a-6bc4d24a2060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1284 microversion: 2.20 time: 0.185529 Aug 08 17:00:30.754226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 25/53] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:30.783365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:30.797887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1a5bb4e6-8ff6-492f-b226-48d4e25eabf7 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1218 microversion: 2.1 time: 0.166564 Aug 08 17:00:30.799615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 29/54] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:30 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:31.645001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:31.647813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:31.661718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.662775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.664131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.665191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.665929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.666524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.770815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:31.781766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a039e4c-f8db-4299-921a-5b7824be8c5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1218 microversion: 2.1 time: 0.147151 Aug 08 17:00:31.782715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 26/55] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:31 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:31.796024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:31.810650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:31.824161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:31.825288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:31.826669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.833218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.833218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.833218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.833218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.833738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.836896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.837779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.838612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.840131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:31.841016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:31.841951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:31.997535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:32.013270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:32.014713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:32.019541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:32.022823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76e4e469-ff2d-4f7d-a4df-5a6e96318758 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1210 microversion: 2.1 time: 0.206125 Aug 08 17:00:32.023454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-345e2a13-4ae5-4423-a676-22d6d332f40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1276 microversion: 2.20 time: 0.249789 Aug 08 17:00:32.025014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 27/56] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:31 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1210 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:32.038688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 30/57] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:32.827082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:32.827704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:32.835408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:32.836444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:32.836621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:32.837313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:32.837809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:32.838261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:33.045108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:33.045760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:33.056846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:33.057344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:33.058000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:33.058713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:33.059173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:33.059752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:33.076168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:33.091319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f3f20c9-73f2-49dd-ba6e-7642c74c8473 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1274 microversion: 2.1 time: 0.278423 Aug 08 17:00:33.105875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 28/58] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:32 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:33.116303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:33.117510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:33.128517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:33.129301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:33.130318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:33.134738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:33.140055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:33.140055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:33.141555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:33.155506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff246726-ff16-4b93-bcb5-e9a674f7a257 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1274 microversion: 2.1 time: 0.114541 Aug 08 17:00:33.156870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:33 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:33.229421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:33.239909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:33.241958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:33.243140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e884a96-31b8-48e2-8ff3-bbddb9a45ae2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1332 microversion: 2.20 time: 0.134590 Aug 08 17:00:33.243697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 29/60] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:34.118999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.123917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.171257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.172275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.176788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.178834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.179915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.182092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.182829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.184789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.198510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.199014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.199456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.200180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.200644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.201072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.403790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:34.426079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6236efb4-96f9-4b2c-839c-bd1cf12dfb43 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1272 microversion: 2.1 time: 0.245564 Aug 08 17:00:34.430867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:34.434998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 30/61] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:34 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:34.446653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a475984e-0fb3-404d-b047-402ac6084fbe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1282 microversion: 2.1 time: 0.329762 Aug 08 17:00:34.448036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 32/62] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:34 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:34.456451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.458056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.471251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.472995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.474351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.478695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.479596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.480139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.670390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:34.681395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:34.683009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:34.684407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-22271f56-ddcf-45a1-8505-eac6d3c0f52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1338 microversion: 2.20 time: 0.240567 Aug 08 17:00:34.684969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 31/63] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1338 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:35.460112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:35.460825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:35.479673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.479673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.479954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.480596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.481069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.481502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.481632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:35.482171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:35.501999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.501999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.516559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.518110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.524896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.536302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.636960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:35.647360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-61d951dc-abe6-4390-b9c6-93bdb1d344aa tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1272 microversion: 2.1 time: 0.192221 Aug 08 17:00:35.650401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 33/64] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:35 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:35.695692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:35.717657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:35.717657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:35.718047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2cdab0e8-0df4-43dd-b61d-34a29b031b18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1280 microversion: 2.1 time: 0.234869 Aug 08 17:00:35.718047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 32/65] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:35 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:35.719667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.720368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.721050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.722022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.724393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.725685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:36.674373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:36.676354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:36.694024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:36.696532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:36.697323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:36.699626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:36.702838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:36.704260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:36.705658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:36.708153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:36.712659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:36.716418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-afe49e5e-c49d-4cd6-b8fc-d52581cfd5dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 1.009932 Aug 08 17:00:36.717519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:36.748206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:36.748877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:36.762774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:36.769646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:36.770688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:36.777649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:36.781545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:36.782489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:36.960421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:36.981845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-56ca8345-6c02-4846-ae2a-3cb5ea6bc57f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.315765 Aug 08 17:00:36.992832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:36 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:37.110895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:37.122566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0e844a17-f925-47a9-a749-a1cfea1cafe3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.377749 Aug 08 17:00:37.124000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 35/68] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:36 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:37.749220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:37.753630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:37.762315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:37.772918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:37.774793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:37.775538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:37.777538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:37.778302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:37.779111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:37.980360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:37.992578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:37.994950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:37.996335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f2fd38d-76ce-41e7-b229-e77b340390bc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.258261 Aug 08 17:00:37.996888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 34/69] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:38.019187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:38.024024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:38.027087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:38.028926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.029651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.030409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.031666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.032398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.033045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.275849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:38.275849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:38.275849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.275849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.276584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.276584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.276584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.276584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.277098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:38.277098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2e623138-0002-4785-b920-b40378ea9479 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.194213 Aug 08 17:00:38.277098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 36/70] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:38 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:38.277382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=18 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:38.345201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:38.354577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8a80f11-fcf1-4aed-98ef-9fea3e8d2811 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.213203 Aug 08 17:00:38.355401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 35/71] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:38 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:39.024903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:39.026258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:39.033569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.034087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.034529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.035369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.035836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.036260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.265989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.271965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.278765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.280160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-34b6c5c8-3f1e-430a-8d0e-153680b3e07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.259883 Aug 08 17:00:39.289822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:39.300689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:39.301561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:39.309071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.309669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.310406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.311512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.311826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.312243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.378540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:39.379163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:39.386138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.395750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.395750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.395750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.395750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.396222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.477650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.506757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-46635104-d944-40c6-92b2-7bbf079d9ae9 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.197537 Aug 08 17:00:39.507366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 36/73] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:39 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:39.531985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=24 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:39.554424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.561987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b48b3658-caf0-48cc-ba4c-959d180c08c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.187513 Aug 08 17:00:39.562565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 38/74] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:39 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:40.318072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:40.319238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:40.342444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.343169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.347453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.348438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.349223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.350338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.523787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:40.525452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:40.542708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.543433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.544336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.546938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.550958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.551727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.761926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.778033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.784135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-69335133-e937-4ca0-98bc-b028152b4d99 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.270855 Aug 08 17:00:40.801668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 39/75] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:40 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:40.803639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.806897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:40.807513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:40.808326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.810776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-332ead1e-8587-41a5-ade0-f0b9be212319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.497741 Aug 08 17:00:40.821647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 37/76] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:40.822273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.822273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.822273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.822273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.822543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.822543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.989491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:41.001701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a49e1a08-fbf3-4bcd-9138-f7a6076df4ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.197936 Aug 08 17:00:41.012638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 40/77] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:40 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:41.813429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:41.814697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:41.828863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.829624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:41.840888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:41.841651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.845083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:41.845751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:41.846991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:41.847962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:41.862119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.864428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:41.864873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:41.867588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.868086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:41.868525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:42.098923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.113624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0d9746a-f842-4757-8182-0e9c3499ccbe tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.307700 Aug 08 17:00:42.116184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 38/78] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:41 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:42.122028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:42.124135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:42.136050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:42.140263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:42.141034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:42.147184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:42.148016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:42.151669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:42.152697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.178926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.186353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.189535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7a7b152-c58f-444c-8c4d-ae9d498f6f3c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.347679 Aug 08 17:00:42.191225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 41/79] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:42.342271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.346166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:42.350970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42b285b5-1b1b-4379-bb7d-c0a13c928d29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.233181 Aug 08 17:00:42.351201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 39/80] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:42 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:43.151606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:43.152615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:43.159043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.159537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.160169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.160901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.161410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.162447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.217284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:43.219555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:43.236365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.238669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.239423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.240753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.241319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.241866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.324691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.330092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:43.338519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eae7cfcf-a9ce-424f-bac1-46cdd83efdfd tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.191278 Aug 08 17:00:43.339545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 42/81] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:43 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:43.375424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:43.376074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:43.382833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.383292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.383730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.384475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.384980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.385479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.414155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.423446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.425152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.426471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1dc041e1-b95c-49db-b9b9-d305251ae580 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.214472 Aug 08 17:00:43.434712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 40/82] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:43.558953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.570129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7e2543c-eacf-4d45-b138-46b1612c51c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.198683 Aug 08 17:00:43.570779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 43/83] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:43 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:44.372383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:44.373992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:44.385132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.386056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.386746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.387744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.388351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.389034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.453901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:44.455230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:44.463400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.463901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.464535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.465275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.465949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.466387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.566095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.579131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c66e8147-2983-4488-ab68-b38e7fcbd480 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.210836 Aug 08 17:00:44.579827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 41/84] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:44 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:44.592356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:44.593312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:44.602114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.602712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.603235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.603965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.604457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.604889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.634294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.652707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.652707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.652707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7ba52acc-6b59-4244-a5ae-cec8e27e2c0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.199043 Aug 08 17:00:44.653170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 44/85] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:44.803899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.812654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a200a346-b709-49d8-a1f1-f18c62ca62b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.224807 Aug 08 17:00:44.826666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 42/86] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:44 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:45.610302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:45.610925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:45.617354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:45.619333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.620059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.621166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.621486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.622054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.622564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.677503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:45.681927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:45.695493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.695986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.696418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.697128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.698251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.707448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.884877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:45.894380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1d9e4b8-33a1-4886-a28d-a8610c25f431 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.288450 Aug 08 17:00:45.930122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 45/87] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:45 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:45.937706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:45.939323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:45.948132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.948957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.950399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.951554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.952233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.952870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:46.002375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:46.016267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:46.017857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:46.019266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fee651ac-04db-476f-ad0b-fda21aaa7186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.349352 Aug 08 17:00:46.020176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 43/88] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:46.163908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:46.180438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4172885b-2867-400c-b639-72f2b9e4ade6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.240997 Aug 08 17:00:46.180438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 46/89] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:45 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:46.945064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:46.945769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:46.947764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:46.952622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:46.953111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:46.953555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:46.954252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:46.954705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:46.955122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.047227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:47.047937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:47.055073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.055579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.071099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.071099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.071099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.071099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.133109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.155085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-df04a6d4-3f39-4fda-bbba-8325e8a839e6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.225094 Aug 08 17:00:47.155731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 44/90] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:46 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:47.194731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:47.195345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:47.213396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.213396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.213396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.213396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.214240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.214240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.338541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.356030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.357883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.367770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bdcf1b07-618d-402c-9fff-df9695464e1c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.316780 Aug 08 17:00:47.367770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 47/91] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:47.425309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.428939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ead2439f-588a-406d-ac01-f17354a8a1ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.238101 Aug 08 17:00:47.444332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 45/92] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:47 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:48.194374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:48.194374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:48.194374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.194374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.195137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.195137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.195137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.195137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.391659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:48.391659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:48.396422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.397034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.397903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.398802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.399421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.399967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.563585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.597806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-00d13e68-d034-4518-9fd0-43934e771be2 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.420375 Aug 08 17:00:48.598559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 48/93] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:48 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:48.612384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:48.613205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:48.626841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.630416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.632335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.636000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.636649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.637501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.698543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.701951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.704812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.706580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a360f33-986f-4aca-bfda-0460829f59f6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.325381 Aug 08 17:00:48.707544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 46/94] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:49.086926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.116812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-19810f3d-930a-4d43-924b-881aa4884ef9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.500075 Aug 08 17:00:49.118380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 49/95] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:48 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:49.227851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:49.254331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.254940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.258906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.324370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Creating event network-changed:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:00:49.324941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 17:00:49.325341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ba6022df-686c-4c96-82f9-9830892f9f4f req-8214d974-9cf2-4a65-9b0d-b9881662094a service nova] Acquired lock "compute-rpcapi-router" {{(pid=130501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 17:00:49.326482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.327019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.327601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.328329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.328793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.329418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.340651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.compute.rpcapi [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 17:00:49.341319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] Releasing lock "compute-rpcapi-router" {{(pid=130501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 17:00:49.356499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6a33b1-1daa-484f-9980-ce179a581c15", "tag": "08fa73c0-81da-4cbe-af4b-96ae37f81ad9"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:49.379653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.380892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.381407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.386333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f1575443-c9ba-4bbe-83ab-7df05d1e7121 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336726 Aug 08 17:00:49.387369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 47/96] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:49.408025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Creating event network-changed:08fa73c0-81da-4cbe-af4b-96ae37f81ad9 for instance 4f6a33b1-1daa-484f-9980-ce179a581c15 on hv-cinder-85221 Aug 08 17:00:49.408676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 17:00:49.409138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-03a268cd-6cba-4cee-8a97-a258e2da5e76 req-2579e4de-95f4-4d5c-96bc-f6483ed064ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=130500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 17:00:49.410467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.411012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.411978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.412392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.412977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.413722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.424399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.compute.rpcapi [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 17:00:49.438068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] Releasing lock "compute-rpcapi-router" {{(pid=130500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 17:00:49.444769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1530d9f-70ff-499d-bd61-98cff74e4002 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324952 Aug 08 17:00:49.445410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 50/97] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:49.630230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:49.630927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:49.637524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.638032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.638468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.639153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.639608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.640033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.732347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:49.888360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:49.888360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.888360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.888360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.889267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.889267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.889267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.889733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.889733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-925872e6-3638-4edc-96da-49ebf609ead5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.173142 Aug 08 17:00:49.889733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 48/98] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:49 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:49.890047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.895219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.897509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.898954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1444c6f2-6a70-4806-ad32-3110b6e079aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.171850 Aug 08 17:00:49.899529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 51/99] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:50.147862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:50.148407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:50.154442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.154923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.155352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.156037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.156486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.156906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.306698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:50.313935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0b64e222-dc28-4263-9b61-1062e82f16a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.170120 Aug 08 17:00:50.314715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 49/100] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:50 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:50.906633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:50.907259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:50.919842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.921210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.925092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:50.926091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.926883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:50.928045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.928970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.929775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.967332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.967332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.967332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.967332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.967741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.967741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.471127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:51.484635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:51.494873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:51.497513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f7ce83e-e066-4b0f-9837-03c8cb2622c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.577738 Aug 08 17:00:51.498861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 50/101] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:51.504523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:51.505945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:51.523562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.524269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.524886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.528736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.529529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.534317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.549571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:51.561339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e701d03e-a267-44bf-bfdc-9daf56694b4f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.658650 Aug 08 17:00:51.565923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 52/102] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:50 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:51.573933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3506c2e4-aa88-4ed1-aa43-8d51b419907d", "tag": "a5236cb8-d875-46e6-abc5-0f4357f6e84d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:51.584771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.585335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.585843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.604961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] Creating event network-changed:a5236cb8-d875-46e6-abc5-0f4357f6e84d for instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d on hv-cinder-85221 Aug 08 17:00:51.610769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-7f19f2ce-440d-4492-b78c-1f1334d25929 req-b41b8594-e533-476c-b599-662eb2f1980e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046919 Aug 08 17:00:51.611650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 53/103] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:51.622883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ba9523-6baa-452a-9407-f633d15f928c", "tag": "67761731-504f-4628-921c-45de78acffd4"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:51.635149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.635631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.636496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.647917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] Creating event network-changed:67761731-504f-4628-921c-45de78acffd4 for instance a9ba9523-6baa-452a-9407-f633d15f928c on hv-cinder-85221 Aug 08 17:00:51.653595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-5740877a-c3f6-474e-b87a-7c72d1e0ff46 req-2086e927-b6de-4982-b6f3-f90c62ef51c8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039804 Aug 08 17:00:51.654594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 54/104] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:52.000698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.011961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-96bbf764-bc52-476c-9fd0-df72c63211d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.511729 Aug 08 17:00:52.029973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 51/105] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:51 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:52.530168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:52.531578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:52.539079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:52.539836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:52.540482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:52.541362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:52.542087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:52.542687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:52.590052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:52.590980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:52.619369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:52.620588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:52.621232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:52.622686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:52.623389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:52.624029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:52.757832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.760580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.762457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.763628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f377c7f0-3e8c-4c3f-91e2-797eba5a18e7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.240881 Aug 08 17:00:52.764286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 55/106] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:52.795991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.804489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d28aecdd-a522-4438-b420-cd644e2f7108 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.223485 Aug 08 17:00:52.805061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 52/107] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:52 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:53.037056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:53.037677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:53.044150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.051258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.051258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.051258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.051258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.051666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.203293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.212766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d5cbf7d4-6273-477b-9ab5-96958068df7f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.180271 Aug 08 17:00:53.213593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 56/108] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:53 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:53.786547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:53.787188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:53.799212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.799212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.799212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.799212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.799711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.799711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.826783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:53.827659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:53.835674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.842771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.842771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.842771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.842771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.843268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.968730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.979555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.982063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.984263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ff802b5-cb24-431a-a228-23c41e5dc5d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.202351 Aug 08 17:00:53.985248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 53/109] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:54.235507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:54.236545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:54.247983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:54.249654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:54.250965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:54.252973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:54.254348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:54.256545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:54.299426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:54.310734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc6f8ce2-1d61-471c-8c27-378842eead7d tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.488613 Aug 08 17:00:54.312399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 57/110] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:53 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:54.479194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:54.487729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d59a5b0-a292-4c37-bd05-f3d8933740da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.256676 Aug 08 17:00:54.505530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 54/111] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:54 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:55.011773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:55.012383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:55.018739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.023801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.023801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.023801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.023801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.024135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.167627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.178093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.180203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.181805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e4f4e3c3-6f93-42e3-92bc-5ac0c04d5d3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.174036 Aug 08 17:00:55.182549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 58/112] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:55.335250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:55.336131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:55.343589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.345139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.345827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.346531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.346989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.347405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.509646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:55.513466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:55.516821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.523570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.531491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.531990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.533087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.533271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dee00f98-1226-4bd1-bacb-2773ac2c7a3e tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.202219 Aug 08 17:00:55.545815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.545815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.546715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:55 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:55.739616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.748511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e51e640f-a3a5-4362-9c7d-0eef8e3bf2a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.243661 Aug 08 17:00:55.750862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 59/114] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:55 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:56.205595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:56.206286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:56.212862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.213350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.213808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.215835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.216406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.216900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.371029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:56.374631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:56.380631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:56.383459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:56.385666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-184adcd9-8d88-45c2-abc9-805f19f7fd2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.183599 Aug 08 17:00:56.386667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 56/115] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:56.555391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:56.556098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:56.562062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.562665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.563234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.563985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.564537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.565040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.772392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:56.773066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:56.780010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.780712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.781330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.782231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.782829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.783441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.825299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:56.852148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-41529b16-7065-4e46-933a-8a3d3a89731f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.300205 Aug 08 17:00:56.853140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 60/116] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:56 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:57.024421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.032513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6785a568-5003-4b01-bb3b-e309d16a3957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.264600 Aug 08 17:00:57.033186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 57/117] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:56 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:57.414436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:57.414436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:57.419297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:57.419858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:57.420305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:57.421000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:57.421462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:57.421910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:57.426091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:57.611905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.619932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.621492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.622843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4c3622e8-a5be-4f72-8bf7-8accd93355cb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.215752 Aug 08 17:00:57.623870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 61/118] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:57.875565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:57.880576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:57.896655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:57.897219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:57.898227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:57.898954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:57.900003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:57.900934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.059855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:58.059855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:58.066111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.066699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.067798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.087343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.088334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.089004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.237538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:58.237538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ce5d290-a4ca-4665-a8af-c7caecbaa685 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.353891 Aug 08 17:00:58.237538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 58/119] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:57 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:58.338397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:58.345204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-293da235-ff06-42b8-9665-c38df1446aba tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.294877 Aug 08 17:00:58.346288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 62/120] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:58 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:58.645445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:58.646274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:58.653136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.653952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.654755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.655779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.656579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.657158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.010274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.018971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.021640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.022890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-874814fa-3a2f-4540-8298-8b0b7f3b0dcd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.381451 Aug 08 17:00:59.023537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 59/121] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:59.260068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:59.261847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:59.280033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.280435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.280888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.282528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.282673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.283162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.369444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:59.370900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:59.373339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:59.384086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.384086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.384086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.384086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.384424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.384512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.423122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:59.531243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.542247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0872620c-6623-4db9-8a03-806da0b556a4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.291122 Aug 08 17:00:59.545528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 63/122] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:59 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:59.630895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.641967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63281f30-baa2-4459-a551-62a6ae11b977 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.278543 Aug 08 17:00:59.643910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:59 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:00.047418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:00.048147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:00.054893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.060216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.060216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.060216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.060216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.060804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.087325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ba9523-6baa-452a-9407-f633d15f928c", "name": "network-vif-plugged", "status": "completed", "tag": "67761731-504f-4628-921c-45de78acffd4"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:00.106295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.106776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.107201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.123701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] Creating event network-vif-plugged:67761731-504f-4628-921c-45de78acffd4 for instance a9ba9523-6baa-452a-9407-f633d15f928c on hv-cinder-85221 Aug 08 17:01:00.130540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-6d9fd2db-492f-42e2-9379-0d9b6e237a61 req-6be1e282-d7f7-43c2-b0d6-5f7265eff9c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307452 Aug 08 17:01:00.131604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 64/124] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:00.253626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:00.279831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:00.279831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:00.279831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a280bb7e-1dbb-41a5-a78f-b6621e2cc1f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.236303 Aug 08 17:01:00.280753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 61/125] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:00.574179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:00.575804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:00.588477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.588477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.588477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.588477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.589042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.589042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.678080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:00.682309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:00.694847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.695381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.695824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.696536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.697245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.697682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.818729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:00.828496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ef581d7e-d251-4d20-be91-ce873c273c45 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.264258 Aug 08 17:01:00.829067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:00 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:00.907427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:00.916014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a0fc1834-63c7-4161-8d14-1b65a7d999dd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.242404 Aug 08 17:01:00.916595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 62/127] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:00 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:01.304596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:01.305208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:01.317728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.317728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.317728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.317728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.318328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.318328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.637125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.645862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.647404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.648513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f53def63-f043-4b3f-8d5c-6b4547472467 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.348617 Aug 08 17:01:01.649220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 66/128] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:01.850210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:01.851383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:01.859856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.859856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.859856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.859856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.862757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.862757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.938211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:01.939204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:01.955104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.955609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.956079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.956847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.957329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.957823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.239807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.250406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-47fe85de-d3ba-4218-bb5e-3079094667eb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.404606 Aug 08 17:01:02.253638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 63/129] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:01 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:02.288171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3506c2e4-aa88-4ed1-aa43-8d51b419907d", "name": "network-vif-plugged", "status": "completed", "tag": "a5236cb8-d875-46e6-abc5-0f4357f6e84d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:02.297988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.300372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.302445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.315410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] Creating event network-vif-plugged:a5236cb8-d875-46e6-abc5-0f4357f6e84d for instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d on hv-cinder-85221 Aug 08 17:01:02.324956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-8e93cb97-abd9-4d5e-a6d9-eb8450a76a26 req-fc8fe05b-d50e-4d31-9cbe-f1271123c19a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067608 Aug 08 17:01:02.326719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 64/130] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:02.378948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.411710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5f1ffaf8-8173-40dd-88d7-fa8dd0ed3d96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.458457 Aug 08 17:01:02.433749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 67/131] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:01 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:02.672816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:02.673981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:02.683515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.684005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.684445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.685142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.685598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.686066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.825840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.834881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.836248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.837693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8edf477d-3f92-495f-9923-2930751cab82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.169642 Aug 08 17:01:02.838479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 65/132] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:03.285705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:03.286389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:03.295894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.296637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.297141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.298592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.299064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.299586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.434657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:03.435502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:03.442435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.442928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.448141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.448141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.448141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.448141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.531921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:03.547362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0200df67-9d5b-46a5-b408-aaade107dec3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.265719 Aug 08 17:01:03.548641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 68/133] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:03 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:03.689409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:03.698665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c14a7de5-72eb-47c9-b5be-ede9445028aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.267849 Aug 08 17:01:03.711991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 66/134] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:03 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:03.860448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:03.861055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:03.868794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.869281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.869710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.870439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.870890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.871362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.029544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.038146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.039615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.040858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7701cfdc-20bc-43e7-bf5a-4a767ab91363 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.184129 Aug 08 17:01:04.041507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 69/135] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:04.570182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:04.570794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:04.576721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.577202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.577636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.578367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.578821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.579262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.720232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:04.720948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:04.728714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.729507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.729981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.730979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.731437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.731866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.734678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.742352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dbdb2342-5239-40bd-bc30-f4f84ccabfec tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.176954 Aug 08 17:01:04.742925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 67/136] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:04 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:04.925348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.934376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7d3204ac-71a1-4617-a806-6a80c43ddb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.218400 Aug 08 17:01:04.935282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 70/137] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:04 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:05.064690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:05.065334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:05.082070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.082601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.088672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.088672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.088672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.088672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.265114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.273249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.274757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.276045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1539956d-b3c4-4bdb-a25e-9ed3ba0739e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.215420 Aug 08 17:01:05.276594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 68/138] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:05.763131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:05.764339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:05.772637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.773195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.773947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.774832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.775668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.776273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.916818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.924626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aabc7775-0064-4f43-8e14-0cb018522056 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.165566 Aug 08 17:01:05.925196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 71/139] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:05 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:05.955314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:05.955920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:05.963003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.963798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.964484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.965324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.965878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.966467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.113062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:06.120560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f76c3247-0cac-4f9f-9726-c5f3a4135b8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.168984 Aug 08 17:01:06.121052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 69/140] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:05 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:06.299593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:06.300218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:06.306193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.306671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.307108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.307799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.308256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.308682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.449333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:06.457517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:06.459126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:06.460393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3bfc8139-587a-4ff8-89b4-15a60186fe29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.164766 Aug 08 17:01:06.460952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 72/141] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:06.948212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:06.948212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:06.958167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.959607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.960229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.961161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.962599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.963380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.143343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:07.144631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:07.154869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:07.155636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:07.160844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.160844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:07.160844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:07.160844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.162393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.173459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f3f6e1ad-87ed-409e-b390-663e861b5dc0 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.232583 Aug 08 17:01:07.176910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 70/142] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:06 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:07.483191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:07.484180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:07.499559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.500448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:07.501051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:07.501670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.502511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:07.503056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:07.508634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-539a2e9b-cde1-441f-9a18-2f715d180a52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.370108 Aug 08 17:01:07.509219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 73/143] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:07 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:07.511239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.773767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.783684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.789300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.794660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-029bc11e-88b6-44c3-8f7d-c123c0b37910 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.315683 Aug 08 17:01:07.795501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 71/144] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:07.861035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6a33b1-1daa-484f-9980-ce179a581c15", "name": "network-vif-plugged", "status": "completed", "tag": "08fa73c0-81da-4cbe-af4b-96ae37f81ad9"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:07.872371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:07.872857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:07.873283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.885069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] Creating event network-vif-plugged:08fa73c0-81da-4cbe-af4b-96ae37f81ad9 for instance 4f6a33b1-1daa-484f-9980-ce179a581c15 on hv-cinder-85221 Aug 08 17:01:07.890167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-90010b8b-3c4a-4093-b8a4-984776f0b0cb req-f8b2e2be-fccc-432b-b0b1-3b08e433a9dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Aug 08 17:01:07.890843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 74/145] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:08.198257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:08.198871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:08.206593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.207447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.208458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.209721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.210363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.210954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.385403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.395482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-802fb26a-240f-4da7-a110-be6f289d8903 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1314 microversion: 2.1 time: 0.199924 Aug 08 17:01:08.406292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:08 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:08.532949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:08.534512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:08.540952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.541443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.541899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.543102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.543560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.544014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.706699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.715732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1fa4bb9a-6f2f-486d-ad19-eccf28527ebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.187453 Aug 08 17:01:08.716511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:08 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:08.820896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:08.821505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:08.827637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.828112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.828796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.829657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.830133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.830766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.055080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.066046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.069963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.071827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-48193fab-d121-431f-b46c-c263594e6784 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.255666 Aug 08 17:01:09.072727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 73/148] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:09.420180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:09.420930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:09.427730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.428220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.428703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.429407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.429905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.430335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.647795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.658510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2e07106d-8662-426c-acb0-800bbe13f4c5 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1502 microversion: 2.1 time: 0.243610 Aug 08 17:01:09.660730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 76/149] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:09 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:09.736835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:09.737611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:09.744042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.744533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.744980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.745682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.746269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.752027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.752027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:09.888641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.902989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9a18fc86-881b-404b-90c2-389f1330de76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.164506 Aug 08 17:01:09.902989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 74/150] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:09 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:09.906039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "name": "network-vif-plugged", "status": "completed", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:09.916330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.916806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.917232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.929955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] Creating event network-vif-plugged:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:01:09.943054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-8db36f00-e9fd-4af7-b5ae-0110ed0e3be2 req-7484080c-6cd4-4b15-95b6-cdcd6e248426 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Aug 08 17:01:09.943054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 77/151] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:10.098109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:10.098712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:10.105317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.106132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.106793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.107703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.108374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.109406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.273091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:10.281975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:10.283584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:10.284864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a78c2971-4b91-4020-91cd-c8aadfb79281 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.190832 Aug 08 17:01:10.285460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 75/152] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:10.920161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:10.921548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:10.940688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.940688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.940688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.941588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.942281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.943111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.132450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.146948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7ac56bca-8e64-4a60-843a-01205fee7a5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.229061 Aug 08 17:01:11.147572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 78/153] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:10 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:11.308243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:11.310379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:11.317881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:11.318364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:11.318792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.319480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:11.319927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:11.320343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.459942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.468083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.469604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.471013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ec9ee6e4-2e65-436f-90e0-d9d72962b195 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.166788 Aug 08 17:01:11.471263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 76/154] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:12.184028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:12.184028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:12.190742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.191760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.192202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.192903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.193353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.193776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.382584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.386356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:12.390679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a39bcd71-2949-4909-bb03-8b65266bdedb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.225828 Aug 08 17:01:12.391257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 79/155] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:12 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:12.493929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:12.494548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:12.503088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.504226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.504730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.505436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.505960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.506391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.669359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.679970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.681585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.682838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49acdc87-0459-4bee-8e49-b7aecfd1164d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.192948 Aug 08 17:01:12.683484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 77/156] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:13.412812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:13.413428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:13.419898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.420385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.421187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.425017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.425017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.425017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.587704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.596005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-edc2508e-2133-4f9b-8182-56ac872b3fb3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.188349 Aug 08 17:01:13.597824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 80/157] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:13 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:13.708394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:13.709142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:13.715732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.716272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.716708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.717434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.717894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.718327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.857229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.865374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.866912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.868026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c822b23-353d-4f0f-8699-6cfcc106855c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.165751 Aug 08 17:01:13.868588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 78/158] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:14.622988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:14.623918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:14.634954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.635928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.636719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:14.637918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.638641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.639276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:14.813288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:14.821606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4ff7e250-be63-4ff4-8250-41ca61485cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.204950 Aug 08 17:01:14.822215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 81/159] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:14 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:14.890437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:14.891176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:14.898150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.898741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.899267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:14.899954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.900409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.900823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.036993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:15.045301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:15.049560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:15.049560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-992aca7d-0b58-4bd6-8ccc-cbc8de86da8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.161460 Aug 08 17:01:15.049560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 79/160] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:15.347746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a34d019e-05d0-4f51-be6c-ab37ef62e246"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:15.350266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:15.356391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.356880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.357312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.358097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.358481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.358903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.843367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:15.844080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:15.851115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.851335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.851773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.852472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.853115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.853540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:16.041387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.049332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3267c59e-edb7-4b0d-a448-be7fb882da8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1322 microversion: 2.1 time: 0.209836 Aug 08 17:01:16.049816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 80/161] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:15 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:16.071243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:16.072324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:16.078303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:16.078823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:16.079265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:16.080031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:16.080489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:16.080914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:16.216513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.225322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.229936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.229936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-183b63aa-64c6-4c78-b0b7-2786cd21787f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.160801 Aug 08 17:01:16.229936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 81/162] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:17.072581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.073190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.079082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.080074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.080636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.080889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.081301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.081817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.215810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.223613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bc09e921-8f58-4866-808c-3f623a809bec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1517 microversion: 2.1 time: 0.154666 Aug 08 17:01:17.224173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 82/163] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:17 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:17.249707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.250415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.257063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.257594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.258022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.258792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.259225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.259652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.406030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.414804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.416318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.417691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-883d1a03-164c-4c3f-807b-4ccf3ae86a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.171749 Aug 08 17:01:17.418303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 83/164] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:17.423690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:17.426660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.441385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.442206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.442827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.444163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.444796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.445361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.514542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'flavor' on Instance uuid 4f6a33b1-1daa-484f-9980-ce179a581c15 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:18.061036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc6be54a-14df-4908-9e7c-5aca5a76fef2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15/action" status: 200 len: 32 microversion: 2.1 time: 0.641413 Aug 08 17:01:18.062206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 84/165] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:01:17 2022] POST /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15/action => generated 32 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:01:18.078670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:18.087524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:18.095233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.095960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.096405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.097169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.097627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.098078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.268607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-299b787f-fb39-46b1-b695-f753c91da5fb tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "POST /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.924732 Aug 08 17:01:18.271685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 82/166] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:01:15 2022] POST /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c/os-volume_attachments => generated 194 bytes in 2927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:18.325513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:18.337226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c8fa91e-1277-410c-b743-8aac905791e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.268415 Aug 08 17:01:18.350239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 85/167] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:18 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:18.444457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:18.444921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:18.452674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.453170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.454778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.455688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.456703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.457142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.660107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:18.692576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:18.695912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:18.705227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-465d91fa-9879-4668-8111-535f7505a39f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1406 microversion: 2.20 time: 0.263873 Aug 08 17:01:18.707009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 83/168] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:19.360030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:19.360826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:19.367109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.367630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.368062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.368762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.369216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.369640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.544938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:19.552779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e53e21ce-02de-4f83-8d22-e8a3355f3a88 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.196702 Aug 08 17:01:19.556451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 86/169] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:19 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:19.732925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:19.735869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:19.750696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.750696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.750696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.750696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.750978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.750978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.933877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:19.943857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:19.946196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:19.947897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6b4ae72b-8fd8-440c-8db5-44b866a84289 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1597 microversion: 2.20 time: 0.220422 Aug 08 17:01:19.948530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 84/170] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:19.971541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:19.972736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:19.983298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.983885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.986724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.986724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.986724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.986724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.066939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-342c7e5c-c48b-4ff2-9055-263ce4830b5e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100210 Aug 08 17:01:20.067553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 87/171] 10.222.0.57 () {60 vars in 1316 bytes} [Mon Aug 8 17:01:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:01:20.574566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:20.575182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:20.581248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.582431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.594025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.595128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.596010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.596771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.780001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:20.788108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8636d502-679e-4bd2-a69c-fdf4f0d1b70f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.217485 Aug 08 17:01:20.788619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 85/172] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:20 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:21.817915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:21.819755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:21.823216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=88 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:21.828278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:21.828860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:21.829512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:21.830479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:21.831819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:21.832463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:22.145680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:22.155758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=82 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:22.163084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:22.167843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:22.174151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:22.197914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] Creating event network-changed:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:01:22.209254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-214e3f37-cfec-48c8-afb4-d07270bec934 req-31c33b81-44e7-4973-bff6-71f763355766 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068186 Aug 08 17:01:22.212369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 86/173] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:01:22.261603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:22.280902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6a3dfcf-3da6-4e53-b64c-79db6a15f17e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.467885 Aug 08 17:01:22.284854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 88/174] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:21 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:23.310945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:23.311655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:23.322816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:23.323316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:23.323765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:23.324498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:23.324963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:23.325405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:23.482875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:23.491462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5dd33493-9383-46ba-92f5-a299e87ae579 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.184793 Aug 08 17:01:23.492115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 87/175] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:23 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:24.513535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:24.514381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:24.521996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:24.522502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:24.522945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:24.534217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:24.534753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:24.535216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:24.558522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:24.705853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:24.713766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5600d622-dcfb-463e-a8f5-7abf1300afd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.205063 Aug 08 17:01:24.714961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 89/176] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:24 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:25.738340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:25.738955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:25.745630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:25.746122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:25.746558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:25.747254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:25.747721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:25.748127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:25.945346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:25.964058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-53e0978e-9dc9-4e1b-8a61-f2fcdfafd5eb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.229414 Aug 08 17:01:25.965110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:25 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:26.990765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:26.990765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:27.004482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:27.005708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:27.006632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:27.008188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:27.009004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:27.009842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:27.229144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:27.242179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-330218fd-4537-4ee3-9394-c1517ade2371 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.260180 Aug 08 17:01:27.243235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 90/178] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:26 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:28.264765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:28.265535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:28.273532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:28.274049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:28.274612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:28.275393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:28.275724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:28.276198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:28.434356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:28.443190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff74b564-2eeb-471f-a6cd-a4a3a3d0088e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.182204 Aug 08 17:01:28.444093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 89/179] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:28 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:29.467973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:29.468755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:29.477552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:29.478427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:29.479187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:29.480070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:29.481059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:29.481837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:29.680958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:29.689007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e629bf8-8fdb-4883-bac5-916fb3ce3a6f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.226972 Aug 08 17:01:29.689527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 91/180] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:29 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:30.710189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:30.711136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:30.727926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.727926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.727926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.727926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.728601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.728601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.960797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:30.961896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:30.969015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.969515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.970008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.970714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.972036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.972678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.981480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:30.994802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-03a6e978-821a-4358-a44a-fbac1a6454e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.288308 Aug 08 17:01:31.004701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:01:31.011676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 90/181] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:30 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:31.495235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-010d69dc-ffc0-4068-87dc-8a8ee9a7ddd4 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 204 len: 0 microversion: 2.1 time: 0.538371 Aug 08 17:01:31.495757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 92/182] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:30 2022] DELETE /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:01:31.503759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:31.504365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:31.510379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.510862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.511295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:31.511981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.512435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.513105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:31.684847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:31.695506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4bd00e6b-756c-4ca7-a0ad-a27968a363db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1554 microversion: 2.1 time: 0.195367 Aug 08 17:01:31.696098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 91/183] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:31 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:32.019331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:32.019938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:32.029612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.029612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.029612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.029612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.030082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.030428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.194810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.202619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ea94d29e-88e7-462a-aa90-dbb15bf8019a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.187797 Aug 08 17:01:32.203199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 93/184] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:32 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:32.718895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:32.719664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:32.727744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.730294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.730294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.730294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.730692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.731086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.909736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.919916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b7cd317-3572-4759-9ae0-9ee62a84f517 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1554 microversion: 2.1 time: 0.206511 Aug 08 17:01:32.920769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 92/185] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:32 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:33.225134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:33.226380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:33.232842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.233567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.234029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.234737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.235257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.235678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.464911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:33.480624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b52820c3-b730-4201-bfee-ebdde608a26d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.259287 Aug 08 17:01:33.500336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 94/186] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:33 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:33.943124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:33.944128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:33.952748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.953237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.953674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.954429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.954891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.955315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.165888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.174948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-36862786-96c7-4586-9c49-943a89fb46a6 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1554 microversion: 2.1 time: 0.236999 Aug 08 17:01:34.175564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 93/187] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:33 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:34.517424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:34.518672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:34.529530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:34.530782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:34.531815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.533377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:34.535118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:34.536081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.811271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.819810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e4b34cc8-d791-495d-a6dd-86cfefe75eab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.306928 Aug 08 17:01:34.830133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 95/188] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:34 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:35.204491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:35.205278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:35.220038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.220038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.220038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.220038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.220405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.221777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.381905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:35.391859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2cd35f01-d9df-46c5-8e6c-f5ba3792895b tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1554 microversion: 2.1 time: 0.192965 Aug 08 17:01:35.392352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 94/189] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:35 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:35.848983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:35.848983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:35.849580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.849947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.850406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.851052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.851496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.851907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.037622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:36.050485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a88f8a11-7dd8-4d3c-ae1f-b81096e445af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.211599 Aug 08 17:01:36.052310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 96/190] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:35 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:36.244853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ba9523-6baa-452a-9407-f633d15f928c", "name": "network-vif-deleted", "tag": "67761731-504f-4628-921c-45de78acffd4"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:36.278126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.279554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.280608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.319497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] Creating event network-vif-deleted:67761731-504f-4628-921c-45de78acffd4 for instance a9ba9523-6baa-452a-9407-f633d15f928c on hv-cinder-85221 Aug 08 17:01:36.329582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-ac8f4639-1ecd-467d-bac0-b9727b6ece17 req-6d7be6dd-16fd-4a70-8225-ee9c1e0b2020 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089057 Aug 08 17:01:36.330697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 95/191] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:36.415591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:36.416477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:36.422244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.422721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.423204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.423824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.430359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.431019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.506072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:36.514696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d5468207-fd10-4724-ab32-426042736f67 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1512 microversion: 2.1 time: 0.103168 Aug 08 17:01:36.515257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 97/192] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:36 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:37.072723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:37.073724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:37.081104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.082787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.083699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.084637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.085262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.085675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.110728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:37.350337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.359682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e4428602-eb0b-4840-9139-fd6928112a30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.290948 Aug 08 17:01:37.360625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 96/193] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:37 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:37.536293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:37.537250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:37.545372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.545900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.546339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.547040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.547493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.547914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.587845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.588013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.588404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.588897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lazy-loading 'fault' on Instance uuid a9ba9523-6baa-452a-9407-f633d15f928c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:37.667359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.676616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2522acf3-6431-4a53-999d-e6323eaad624 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1350 microversion: 2.1 time: 0.144268 Aug 08 17:01:37.677183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 98/194] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:37 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:38.386100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:38.386100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:38.394999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.395576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.396087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.397059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.397599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.398254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.550858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.558448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9df0a927-691a-4bde-b3e2-160ab17c3b9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.177834 Aug 08 17:01:38.559020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 97/195] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:38 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:38.700894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:38.704895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:38.711649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.712146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.712744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.713486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.713978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.714563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.750385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.750875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.751311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.751764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lazy-loading 'fault' on Instance uuid a9ba9523-6baa-452a-9407-f633d15f928c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:38.792650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.801394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d87dd5f1-2ede-4fe5-8bf2-fce5f577fb8c tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1350 microversion: 2.1 time: 0.104938 Aug 08 17:01:38.802013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 99/196] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:38 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:39.586236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:39.586236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:39.591705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.596492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.596492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.596492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.596492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.597029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.757821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:39.765941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-03ab5150-b85c-4158-be40-f99c692790db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.189474 Aug 08 17:01:39.766620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 98/197] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:39 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:39.825229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:39.826361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:39.836020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.836272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.836747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.843843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.843843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.843843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.872525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.873019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.873454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.873924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lazy-loading 'fault' on Instance uuid a9ba9523-6baa-452a-9407-f633d15f928c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:39.924250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:39.933187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0c17cc3-46a1-4442-89a7-82d87b561297 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1350 microversion: 2.1 time: 0.113166 Aug 08 17:01:39.933755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 100/198] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:39 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:40.788892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:40.791208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:40.808121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.809186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.811279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.812987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.813460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.813916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.963503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:40.965162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:40.972935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.973821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.974482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.975295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.975862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.976376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.009388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:41.010030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:41.010538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.011054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lazy-loading 'fault' on Instance uuid a9ba9523-6baa-452a-9407-f633d15f928c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:41.047839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.054892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae31b2903c8e458ca7c68082572db8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9c728a8d56493db7bde4b0bc36f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.055873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-258a2280-6f5a-4e04-93ff-4b7b90e86434 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.272279 Aug 08 17:01:41.056626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 99/199] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:40 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:41.080674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92b09992-3e05-4501-909b-e345916186db tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 200 len: 1350 microversion: 2.1 time: 0.121316 Aug 08 17:01:41.080674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 101/200] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:40 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 1350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:42.076466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:42.077079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:42.084113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.084601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.085037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.085763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.086476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.086708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.103190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:42.104729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:42.113080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.114441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.115496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.116834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.117488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.118319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.152127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] HTTP exception thrown: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Request method failure captured: Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c HTTP/1.1 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEhV4A5UL4FugE2LRXR-q57oT3ZvIn4R-0_CiIhW7UiobIelnNjQGiAhi4IdxFn8gpgMKXKjua6PLL3jGT53ICEkDuGtRIjs3C_8BSjXPJRaySXFqi91CniGa5YZJWqOZX6Jl6TQhQyOVvjGk6BIoJ1G-ZSWCqUgceN0aNFqGuHcl4 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:01:42.177832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db9c728a8d56493db7bde4b0bc36f550", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: ae31b2903c8e458ca7c68082572db8f4 Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.179372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'a9ba9523-6baa-452a-9407-f633d15f928c'} Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:42.180097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.182054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.183579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Returning 404 to user: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:42.183579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e7c5e69-9b1d-46ec-89e7-cc1afd917f01 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 404 len: 111 microversion: 2.1 time: 0.082283 Aug 08 17:01:42.183579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 102/201] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:42 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:42.247617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:42.255693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cd138234-5726-4848-a1b4-009550c893ee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.183064 Aug 08 17:01:42.256269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 100/202] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:42 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:42.301132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:42.303415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:42.309936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.311110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.311110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.311545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.312000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.312424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.325913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] HTTP exception thrown: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Request method failure captured: Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c/os-volume_attachments HTTP/1.1 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEhV4A5UL4FugE2LRXR-q57oT3ZvIn4R-0_CiIhW7UiobIelnNjQGiAhi4IdxFn8gpgMKXKjua6PLL3jGT53ICEkDuGtRIjs3C_8BSjXPJRaySXFqi91CniGa5YZJWqOZX6Jl6TQhQyOVvjGk6BIoJ1G-ZSWCqUgceN0aNFqGuHcl4 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:01:42.327455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db9c728a8d56493db7bde4b0bc36f550", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: ae31b2903c8e458ca7c68082572db8f4 Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.328800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': 'a9ba9523-6baa-452a-9407-f633d15f928c'} Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:42.329454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:42.330554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:01:42.331616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Returning 404 to user: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:42.331616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eccbdbfa-e5ee-42a8-a324-0d33e20eebd3 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032465 Aug 08 17:01:42.331616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 103/203] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:01:42 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:43.279720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:43.280477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:43.288261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:43.288766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:43.289206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:43.290066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:43.290520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:43.291194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:43.432885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:43.444852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7b9e5f9d-4a63-4c18-909e-31dff143130e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.167144 Aug 08 17:01:43.444852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 101/204] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:43 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:44.466289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:44.467076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:44.475428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.475968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.476347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.480620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.480620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.480620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.483716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:44.519939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:44.520472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:44.528945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.532674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.533645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.535445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.535947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.536355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] HTTP exception thrown: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Request method failure captured: Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c HTTP/1.1 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEhV4A5UL4FugE2LRXR-q57oT3ZvIn4R-0_CiIhW7UiobIelnNjQGiAhi4IdxFn8gpgMKXKjua6PLL3jGT53ICEkDuGtRIjs3C_8BSjXPJRaySXFqi91CniGa5YZJWqOZX6Jl6TQhQyOVvjGk6BIoJ1G-ZSWCqUgceN0aNFqGuHcl4 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:01:44.560602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db9c728a8d56493db7bde4b0bc36f550", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: ae31b2903c8e458ca7c68082572db8f4 Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.563410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': 'a9ba9523-6baa-452a-9407-f633d15f928c'} Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:44.565002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.566318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.567691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Returning 404 to user: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:44.567691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d2822b93-aa29-4b3b-8cf9-f44166b74a89 tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 404 len: 111 microversion: 2.1 time: 0.042409 Aug 08 17:01:44.567691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 102/205] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:44 2022] DELETE /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:44.573276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:44.574108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] [instance: a9ba9523-6baa-452a-9407-f633d15f928c] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:44.580835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.581593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.588515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.600045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.600721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.601624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.624531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] HTTP exception thrown: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Request method failure captured: Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c HTTP/1.1 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEhV4A5UL4FugE2LRXR-q57oT3ZvIn4R-0_CiIhW7UiobIelnNjQGiAhi4IdxFn8gpgMKXKjua6PLL3jGT53ICEkDuGtRIjs3C_8BSjXPJRaySXFqi91CniGa5YZJWqOZX6Jl6TQhQyOVvjGk6BIoJ1G-ZSWCqUgceN0aNFqGuHcl4 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:01:44.627960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_db9c728a8d56493db7bde4b0bc36f550", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/db9c728a8d56493db7bde4b0bc36f550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: db9c728a8d56493db7bde4b0bc36f550 Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-DeleteServersTestJSON-553601940 Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: ae31b2903c8e458ca7c68082572db8f4 Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-DeleteServersTestJSON-553601940-project Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.630445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'id': 'a9ba9523-6baa-452a-9407-f633d15f928c'} Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:44.632037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. Aug 08 17:01:44.634904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:01:44.640789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] Returning 404 to user: Instance a9ba9523-6baa-452a-9407-f633d15f928c could not be found. {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:44.640789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9143b78c-3db7-412b-ae5d-fe3c3cf00c0f tempest-DeleteServersTestJSON-553601940 tempest-DeleteServersTestJSON-553601940-project] 10.222.0.57 "GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c" status: 404 len: 111 microversion: 2.1 time: 0.073010 Aug 08 17:01:44.641293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 103/206] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:44 2022] GET /compute/v2.1/servers/a9ba9523-6baa-452a-9407-f633d15f928c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:44.683719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:44.700635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1589e982-e0fe-48ab-9b2e-6ffdca14a285 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.237799 Aug 08 17:01:44.702591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 104/207] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:44 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:45.723877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:45.724497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:45.736855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.737526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.751210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.751480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.753209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.753209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.987746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:45.995775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5152ea52-d830-4c94-bd5b-3c3671e32ec2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.276296 Aug 08 17:01:45.996337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 104/208] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:45 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:47.018199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:47.019863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:47.028085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:47.028589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:47.029545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:47.030602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:47.031219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:47.031661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:47.202638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:47.212503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb9266c6-b245-42b4-b378-7a0eeabaf989 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.198382 Aug 08 17:01:47.213610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 105/209] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:47 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:48.237060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:48.237060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:48.242840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.243382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.243827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.244539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.245103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.245442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.415433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:48.429961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a2898cfb-7b1b-49bf-957f-6997fed440f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.199160 Aug 08 17:01:48.446978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:48 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:49.463154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:49.464398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:49.472583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.473312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.473754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.474514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.475449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.476064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.772972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:49.772972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b345ff5b-01a3-4e25-80c1-4808e863bcdb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.319901 Aug 08 17:01:49.776832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 106/211] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:49 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:50.800011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:50.800626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:50.807157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:50.807896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:50.808336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:50.809047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:50.809500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:50.809957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:50.953990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:50.963243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f2063ee0-b948-46d6-a80a-1123773e4f85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.166911 Aug 08 17:01:50.964168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:50 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:51.985623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:51.987144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:51.994655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:51.995501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:51.996064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:51.996943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:51.997499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:51.998124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:52.186678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:52.197657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1615849d-eb5c-461f-bc3a-6bee655a1320 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.214599 Aug 08 17:01:52.197657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 107/213] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:51 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:53.217908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:53.218505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:53.227632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.228469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.229152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.230053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.230700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.231297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.747767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:53.756763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c254f440-ce51-415a-9128-2ad296797063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.542686 Aug 08 17:01:53.758007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 107/214] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:53 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:54.780793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:54.782111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:54.789212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:54.791811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:54.792520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:54.793145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:54.794263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:54.794881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:54.795467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:55.070407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:55.093556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15797e8c-0583-4168-a9b1-7d0d5d5e118b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.316864 Aug 08 17:01:55.095689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:54 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:56.122097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:56.123914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:56.128804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=44 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:56.144944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.144944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.144944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.144944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.145696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.145696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.361810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:56.371490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d0a1323c-cb83-4d30-b4c9-423bd4917e86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.258232 Aug 08 17:01:56.372384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:56 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:57.399907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:57.401403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:57.413490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:57.416549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:57.417308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:57.418220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:57.418904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:57.419543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:57.662686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:57.677634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6171c177-ac0e-4707-8b59-67a95b2d295a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.283787 Aug 08 17:01:57.679442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 109/217] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:57 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:58.702184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:58.709261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:58.716631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.717627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.718095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.719234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.719462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.720376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.901808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:58.914338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6b3dd55c-2e1f-4a3f-b0ca-d9ea18008ff6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.217432 Aug 08 17:01:58.919554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 109/218] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:58 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:59.740839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bdb37098-fac0-45a5-bf2f-0c142f5ff49c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: .version_select at 0x7f7439417040>, body: {"keypair": {"name": "tempest-keypair-89640920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg++yYAVsSim4P3/pZTm2XF6uTeZCdKzk92/Be3lF6nSCmCeL7tEGdWntdbpjFGCNYQl0RSeN5KYy4ca30zeDbWqjRn5E3lTZ0odIc+W6tYDTDhMUDFcEaZnmG1oRKv9w=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:59.768737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-bdb37098-fac0-45a5-bf2f-0c142f5ff49c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:01:59.772814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-bdb37098-fac0-45a5-bf2f-0c142f5ff49c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:01:59.889710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bdb37098-fac0-45a5-bf2f-0c142f5ff49c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.290342 Aug 08 17:01:59.890894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 110/219] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:01:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:59.947078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:59.947686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:59.954272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.956753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.956753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:59.956753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.957141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.957578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:00.142655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:00.152327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-543a9907-0f75-4dd9-b7ca-ea22c92d1031 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.209255 Aug 08 17:02:00.153179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 110/220] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:59 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:01.174088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:01.174727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:01.180895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:01.181679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:01.182222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:01.182962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:01.183425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:01.183859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:01.369415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:01.377535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-751b8a42-94d9-4af3-ac84-00dab6159504 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.208172 Aug 08 17:02:01.378494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:01 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:02.399143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:02.399896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:02.406172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.406653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.407617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:02.408324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.408778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.409199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:02.580939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:02.592426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-339df5b0-82e0-4fcc-8012-8aa7af3a9f37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.197077 Aug 08 17:02:02.606830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 111/222] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:02 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:02.779907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-231480030", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36f0450b-5607-4e0f-8828-7eaf46e83a10"}], "security_groups": [{"name": "tempest-securitygroup--38161012"}], "key_name": "tempest-keypair-89640920", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:03.624740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:03.625357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:03.633163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:03.633662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:03.634128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:03.634953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:03.635286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:03.635715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:03.800125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:03.807908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a81717df-4068-483b-b951-fe2f785826f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.186965 Aug 08 17:02:03.815534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:03 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:04.835402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:04.836107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:04.845578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.845578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.845578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.845578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.846068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.846068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.983127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:04.991257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-852bb9f3-5f39-4e77-be90-ea3526b49756 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.159659 Aug 08 17:02:04.991831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 113/224] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:04 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:06.014363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:06.015177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:06.022473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.023164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.023672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.024443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.024969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.027781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.047847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:06.168025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:06.177076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5eb3f80c-9e9b-4308-8305-02f3648f6294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.167577 Aug 08 17:02:06.177439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 114/225] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:06 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:07.201502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:07.202360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:07.209490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:07.210032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:07.210556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:07.211295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:07.211801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:07.212143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:07.348431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:07.355678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8f57ef2-6b8c-487c-bdeb-6b2ca6b404c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.158058 Aug 08 17:02:07.356249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 115/226] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:07 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:08.376979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:08.377718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:08.384626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:08.385119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:08.385557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:08.386304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:08.386764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:08.387190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:08.532681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:08.543200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f6881dd3-e26c-4198-bb7e-e7db16fadf16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.170242 Aug 08 17:02:08.543796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 116/227] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:08 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:09.565745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:09.566524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:09.574040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.574536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.574982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.575683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.576187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.576626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.731504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:09.742375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-492c9b5a-309f-4a73-8287-28b97f827667 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.180330 Aug 08 17:02:09.743622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 117/228] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:09 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:09.782715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:10.764595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:10.765204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:10.772686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.773204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.773637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.774403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.774860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.775282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.936714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:10.945983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62ee6059-b08f-4e8d-9fe1-a3bb402b4e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.185224 Aug 08 17:02:10.946565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 118/229] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:10 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:11.376825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=40 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:11.986556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:11.987526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:11.997075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:11.997889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:11.998372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:11.999564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:12.000382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:12.000828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:12.237157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:12.252360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4bf0821b-6b12-4d13-ba8c-a2b05ca427c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.272548 Aug 08 17:02:12.252951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 119/230] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:11 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:12.791339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:13.276908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:13.277516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:13.288309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:13.289216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:13.291330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:13.292706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:13.293939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:13.294631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:13.507499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:13.524767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd72292e-c550-4ee5-ab06-5852c4b05758 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.253801 Aug 08 17:02:13.525497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 120/231] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:13 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:14.550348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:14.551028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:14.564445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:14.565572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:14.566842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:14.567988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:14.568702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:14.569463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:14.761001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:14.776586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c3613bb9-5bcb-41f7-b3e7-fce72c1cc49e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.231288 Aug 08 17:02:14.777180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 121/232] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:14 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:15.809646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:15.809646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:15.809646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:15.809646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:15.810522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:15.811123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:15.811584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:15.812010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:15.946958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:15.954979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ec59cd97-da6d-405a-a249-a8253cf3375e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.158592 Aug 08 17:02:15.955650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 122/233] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:15 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:16.977439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:16.978197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:16.984721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:16.985206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:16.985636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:16.986362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:16.986821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:16.987242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:17.132505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:17.142912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-60633846-4457-44af-aedc-baa4b6070b64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.169088 Aug 08 17:02:17.144410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 123/234] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:16 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:17.268095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-538817972", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "networks": [{"uuid": "170b95b4-5f54-4678-af52-d1d85111a68e"}]}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:19.371927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.network.neutron [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] validate_networks() for [('170b95b4-5f54-4678-af52-d1d85111a68e', None, None, None, None, None)] {{(pid=130500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:02:19.468697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] validate_networks() for [('36f0450b-5607-4e0f-8828-7eaf46e83a10', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:02:19.817003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Flavor limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:02:19.817003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Image limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:02:19.817003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Flavor pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:02:19.817003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Image pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:02:19.817003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:02:19.824264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.824838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.825308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.826082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.826541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.827003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.845484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Getting quotas for project 63b568870ecc4e4797919608bd9273ad. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:02:19.849732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Getting quotas for user e941c29e3df944a08f18f5e029a28977 and project 63b568870ecc4e4797919608bd9273ad. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:02:19.861273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Going to run 1 instances... {{(pid=130500) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:02:19.863594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:02:19.907347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:02:19.907768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:02:19.908308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:02:19.908770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:02:19.909193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:02:19.919278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.921674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.921674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.921674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.921674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.922175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.940265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:02:19.945697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:02:19.956870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:02:19.959149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:02:19.986915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-66df5204-151b-4883-add2-6b09e4d02983 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.722050 Aug 08 17:02:19.987619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 124/235] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:02:19.994006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:19.994006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:19.999760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.000245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.000676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.001364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.001845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.002504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.086560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ebb4efb6-1ed6-4bf7-bb27-990f82f9521f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 17.311073 Aug 08 17:02:20.088142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 112/236] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:02:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 17313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:02:20.093487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5034a550-7f5d-4c03-8d19-b0384a6d510f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:20.094416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5034a550-7f5d-4c03-8d19-b0384a6d510f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:20.171297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:20.173520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5034a550-7f5d-4c03-8d19-b0384a6d510f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:20.182775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5034a550-7f5d-4c03-8d19-b0384a6d510f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1218 microversion: 2.1 time: 0.093347 Aug 08 17:02:20.185967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 113/237] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:20 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:20.186127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-638e0972-3268-46ac-ad90-b044360e5166 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.196542 Aug 08 17:02:20.186127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 125/238] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:19 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:20.193697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-50fab9a3-9daf-427b-beaf-bdfa7ed423e2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:20.194647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-50fab9a3-9daf-427b-beaf-bdfa7ed423e2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:20.255035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-50fab9a3-9daf-427b-beaf-bdfa7ed423e2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:20.258512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-50fab9a3-9daf-427b-beaf-bdfa7ed423e2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1239 microversion: 2.1 time: 0.073855 Aug 08 17:02:20.259090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 114/239] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:21.204140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:21.204749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:21.206006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:21.207137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:21.212085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.212573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.213009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.213707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.214184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.214327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.214607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.214990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.215467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.216162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.216625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.217030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.279721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:21.287889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eeff10f0-f01c-4a0b-a68b-d751a7195d7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1222 microversion: 2.1 time: 0.087770 Aug 08 17:02:21.288645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 126/240] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:21 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:21.293720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:21.294437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:21.300773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.301372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.302035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.302874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.303369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.304458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.372167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:21.374696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:21.380536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1b23cf7-2894-49ef-bd08-8306c4490df4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.178859 Aug 08 17:02:21.381228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 115/241] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:21 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:21.384251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7fe275c-9043-46ea-b4d3-9c90b50c4c14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1243 microversion: 2.1 time: 0.094426 Aug 08 17:02:21.385029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 127/242] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:22.310133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:22.311237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:22.319477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.324080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.324080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.324080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.324080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.324481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.386130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:22.394556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8588477-bddb-4aa8-a15f-bd6a1ed8d504 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1214 microversion: 2.1 time: 0.088886 Aug 08 17:02:22.395070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 116/243] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:22 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:22.404130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:22.404958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:22.405362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:22.406012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:22.411359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.411846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.412286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.413694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.414017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.414188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.414600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.414749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.415892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.416662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:22.417127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:22.417555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:22.502059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:22.511674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8745d071-4bad-4c8b-890e-3beb596d15b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1235 microversion: 2.1 time: 0.111182 Aug 08 17:02:22.512255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 117/244] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1235 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:22.642867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:22.651814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-19ff9a0e-3bd3-4934-a091-c2e260c28a22 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1523 microversion: 2.1 time: 0.251276 Aug 08 17:02:22.652476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 128/245] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:22 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:23.416999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:23.417601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:23.423649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.424127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.424556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.425339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.425809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.426219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.494345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:23.502868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-066ae389-9125-41d9-b002-cf7ffa33d429 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1270 microversion: 2.1 time: 0.090386 Aug 08 17:02:23.503725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 118/246] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:23 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:23.535633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:23.536246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:23.543871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.544413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.544775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.545705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.546369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.546795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.629932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:23.637778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56f0597a-a552-4063-850b-05e33bf05a1a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1291 microversion: 2.1 time: 0.106670 Aug 08 17:02:23.638606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 129/247] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:23.676146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:23.676146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:23.682867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.683361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.683821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.684518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.684992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.685458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.846228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:23.854740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c99f57fe-59db-4bdd-acbf-e1c1f706dde7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1503 microversion: 2.1 time: 0.184152 Aug 08 17:02:23.855318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 119/248] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:23 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:23.884171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:23.884841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:23.899174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.899689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.900128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:23.900841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:23.901298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:23.901730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:24.076684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:24.076684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b8855d60-a229-4465-bd20-b0e255e5b024 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1516 microversion: 2.1 time: 0.175062 Aug 08 17:02:24.076684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 130/249] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:23 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:24.523559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:24.524167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:24.530316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:24.530808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:24.531240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:24.532205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:24.532378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:24.532973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:24.632961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:24.643150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-95971349-4ec0-424a-8bbe-4dee3866640a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1278 microversion: 2.1 time: 0.123301 Aug 08 17:02:24.643724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 120/250] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:24 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:24.660072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:24.661383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:24.669573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:24.672514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:24.672514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:24.672514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:24.672514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:24.672981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:24.760864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:24.770103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:24.797122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9cce2e9-e69a-4064-9aaf-3b15b4e310c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1291 microversion: 2.1 time: 0.140736 Aug 08 17:02:24.800434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 131/251] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1291 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:25.674664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:25.674664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:25.676743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:25.678252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:25.678793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:25.680109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:25.680803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:25.681419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:25.812605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:25.823231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a3e9aed9-8dac-484b-b6e8-2b9f34404860 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1276 microversion: 2.1 time: 0.158252 Aug 08 17:02:25.823845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 121/252] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:25 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:25.830725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:25.831513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:25.839273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:25.840126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:25.840978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:25.842011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:25.842670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:25.844232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:25.994198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:26.005773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e489b59a-b747-47e7-8552-2e8d19a20426 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1309 microversion: 2.1 time: 0.182842 Aug 08 17:02:26.006848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 132/253] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1309 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:26.859993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:26.862610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:26.873393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:26.874301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:26.875106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:26.879305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:26.879305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:26.879305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.029309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:27.030823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:27.041184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.042681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.044047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.051235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.053443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.059138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.209063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:27.226904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bbeff2e1-c5b9-48f1-ae46-708415f5191a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.373217 Aug 08 17:02:27.227756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 122/254] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:26 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:27.233648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:27.236494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:27.243370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.243874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.244308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.245196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.245866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.246494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.285806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'flavor' on Instance uuid 3506c2e4-aa88-4ed1-aa43-8d51b419907d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:02:27.306868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:27.322157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-de773558-ea4b-4018-bcbc-ad4a91360128 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.296991 Aug 08 17:02:27.342001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 133/255] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:27.435366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d590a811-973f-4e31-8808-7471e74086a7", "tag": "39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:27.446591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.447159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.447663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.459914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] Creating event network-changed:39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9 for instance d590a811-973f-4e31-8808-7471e74086a7 on hv-cinder-85221 Aug 08 17:02:27.465403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-7f2aabfd-4365-457b-aeea-80a88ce89f3b req-2f8a857d-2079-4fb6-81fb-209ea9321f02 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Aug 08 17:02:27.466045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 134/256] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:27.738190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ed00bb2-b61e-4e92-90f1-6638f1acd118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/action" status: 200 len: 32 microversion: 2.1 time: 0.508552 Aug 08 17:02:27.738809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 123/257] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:02:27 2022] POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:02:27.750259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:27.751466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:27.757308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.758151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.758592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.759307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.760170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.760616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.903313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c06d12-050a-4dbb-9d04-30953de7661e", "tag": "4bf152b4-252b-448e-a10e-bed9b31db08b"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:27.913223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.913813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.914327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.928517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] Creating event network-changed:4bf152b4-252b-448e-a10e-bed9b31db08b for instance 97c06d12-050a-4dbb-9d04-30953de7661e on hv-cinder-85221 Aug 08 17:02:27.935662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-5ec9649a-fed9-401f-abb6-80277697bc23 req-d36c4b8e-cf1c-4f7e-bf97-5fd7e20029a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036349 Aug 08 17:02:27.942879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 124/258] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:02:28.193521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.203006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dcb1b8c7-54c4-488c-913d-7fb562607e1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.457059 Aug 08 17:02:28.204233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 135/259] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:27 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:28.257633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:28.258354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:28.270539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.270539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.270539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.270539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.271311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.271311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.358777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:28.359200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:28.366320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.367143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.367833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.368815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.369343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.370158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.426746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.435442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-078e022f-08fc-48b7-a8d4-d95e5d859b45 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.182008 Aug 08 17:02:28.436024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 125/260] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:28 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:28.522015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.533190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-78439569-0ba0-41f2-94d8-99dbda59940c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.178685 Aug 08 17:02:28.533190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 136/261] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:29.228295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:29.229746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:29.236982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.236982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.236982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.240304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.240304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.240304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.397762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.405469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8a5aca38-a17a-469a-973c-9a2d27aa3c78 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.182620 Aug 08 17:02:29.406065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 126/262] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:29 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:29.462285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:29.462991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:29.466742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:29.474839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.475349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.476331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.477049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.477510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.480544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.558309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:29.558960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:29.566182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.569997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.569997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.569997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.569997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.570386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.673287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.682857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cca94d10-2b63-4790-afec-db549f9b3f1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.224683 Aug 08 17:02:29.683468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 137/263] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:29 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:29.748630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.759793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0302a7db-ac65-425f-b7ef-0c4b39ce3f8a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.205889 Aug 08 17:02:29.760609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 127/264] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:30.420554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:30.421310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:30.423841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:30.424879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=6 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:30.431813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:30.440547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.440782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:30.440907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.440907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.440907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.440907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.441442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:30.441600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.441750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=10 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:30.447138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.448372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.449402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.450849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.451750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.452521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.475163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d4ad94a2-cba4-4b45-9eee-bd93ab716d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/ips" status: 200 len: 151 microversion: 2.20 time: 0.060629 Aug 08 17:02:30.476599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 138/265] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Aug 8 17:02:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/ips => generated 151 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:02:30.709307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:30.711095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:30.718002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.718500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.718933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.719640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.720315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.720750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.877941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:30.888164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7619e01b-3e9f-4c2c-9db1-b9a51aa1e4b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.462427 Aug 08 17:02:30.889953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 128/266] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:30 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:30.896014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:30.897020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:30.903613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.904346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.904961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.905772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.906253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.906969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.925756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:30.938261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bae1097c-df10-4979-acc1-8527cde708c4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.232836 Aug 08 17:02:30.947361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 139/267] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:30 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:31.144111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:31.152029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:31.161240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-98c2fe00-d0e3-4136-8ef5-f78a6f12402c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.269675 Aug 08 17:02:31.162447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 129/268] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:31.919679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:31.921421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:31.932778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:31.933697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:31.934511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:31.935745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:31.936528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:31.937230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:31.967255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:31.968016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:31.986966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:31.987870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:31.988506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:31.991281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:31.992286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:31.994030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:32.327633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:32.327883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:32.336969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8dbff115-1443-4a6f-89a6-e54d4bee256f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.422813 Aug 08 17:02:32.341079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84c06206-155f-43c5-b2b1-867cfece50e2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.375730 Aug 08 17:02:32.347403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 140/269] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:31 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:32.368798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 130/270] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:31 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:32.368890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:32.368890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:32.368890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:32.383435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:32.386731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:32.386731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:32.386731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:32.386731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:32.924544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:32.934019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-70a570d9-7072-4e00-8507-8d1b87aa9f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.584049 Aug 08 17:02:32.935296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 141/271] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:33.362257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:33.362885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:33.372140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.372637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.373080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:33.373781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.374256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.374690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:33.390841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:33.391484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:33.404433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.405964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.406205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:33.407589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.408467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.409374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:33.579234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:33.591927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40695aec-03ad-4391-adfd-540a5b2f13b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.234557 Aug 08 17:02:33.594535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 131/272] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:33 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:33.630871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:33.644401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0843d50d-0c55-46c7-94b8-ce7d1e985e27 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.257252 Aug 08 17:02:33.645326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 142/273] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:33 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:33.959997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:33.960992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:33.970481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.971279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.972010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:33.973116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:33.973865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:33.974568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.139054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:34.148933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e3411b62-3c10-4066-9b66-1f54144bfab5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.195883 Aug 08 17:02:34.149435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 132/274] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:34.628837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:34.629441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:34.636450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.636975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.637776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.638717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.638717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.639141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.669162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:34.670399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:34.680621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.681586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.682490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.683751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.684647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.685489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.816862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:34.833973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f36634a2-6ccb-44de-a3e8-4d9328011510 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.208577 Aug 08 17:02:34.836501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 143/275] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:34 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:34.890934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:34.902891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-89fd2af7-b7ba-4be1-bae7-cef3fb170a02 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.238280 Aug 08 17:02:34.903834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 133/276] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:34 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:35.073576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:35.074185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.080311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.080801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.081249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.082001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.082579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.083008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.109263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lazy-loading 'flavor' on Instance uuid 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:02:35.170680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:35.171359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.177878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.178367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.179410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.180140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.180782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.181211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.345208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:35.354477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8c585d8-7ecd-4b9d-95ad-fab9fa7216a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.187546 Aug 08 17:02:35.355058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 134/277] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:35.858753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-927d1c0d-ec97-4821-963b-b74057305ff3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action" status: 202 len: 0 microversion: 2.20 time: 0.789563 Aug 08 17:02:35.859348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 144/278] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Aug 8 17:02:35 2022] POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:02:35.870882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:35.872003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.876345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:35.877079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.880759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.881366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.882200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.883193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.883938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.884383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.886472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.886979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.887422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.888139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.888671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.889043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:36.065315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.081222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.083567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.086335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03923fa7-cdba-4e5a-9cc9-d54875f47322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.221138 Aug 08 17:02:36.087284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 135/279] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:36.093037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:36.096465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.097481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:36.108251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:36.110136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1d8d5ac-c572-4424-97ee-a07a5efeb3ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.243707 Aug 08 17:02:36.111177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 145/280] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:35 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:36.111446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:36.112288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:36.113722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:36.114434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:36.115142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:36.332053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.342274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9ee85fd9-a182-4bdb-83fb-3d224b97b2ee tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.253747 Aug 08 17:02:36.342985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 136/281] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:36 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:36.385257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:36.386153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:36.398585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:36.406247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:36.406247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:36.410959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:36.413984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:36.414664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:36.612294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:36.620779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb89f85a-54a3-48dd-a520-db3fa0508f82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.240310 Aug 08 17:02:36.621374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 146/282] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:37.133591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:37.134408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:37.142965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.143767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.144636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.145540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.146197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.146497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:37.147167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:37.147479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.161069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.162912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.165968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.166943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.167961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.168404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.193955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:37.391324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.401057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a5d591f2-ce99-4187-a1eb-65eca8a5bce3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.260460 Aug 08 17:02:37.401978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 147/283] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:37 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:37.407905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:37.409060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:37.417487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.418300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.418957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.419887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.420542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.421167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.510205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.539518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.541990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.557118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-817a3583-d6da-40f9-b972-85bb325e3f04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.432577 Aug 08 17:02:37.566102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 137/284] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:37.655265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:37.656588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:37.674125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.678215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.681918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.683821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.690229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:37.690858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:37.691506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:37.692911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5d392f7c-7650-4d0d-b016-2b9f110db511 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.289118 Aug 08 17:02:37.694218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 148/285] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:37 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:37.981595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:37.992237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ecf1fc01-b0b9-451e-ba5c-7ccc88aa6ce6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.353351 Aug 08 17:02:37.993033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 138/286] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:38.433685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:38.435062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:38.442835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.443338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.443997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.445361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.445988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.446975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.589246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:38.589901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:38.607660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.608408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.609052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.609957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.610608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.611492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.710642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:38.719359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0848d1ba-7f3b-46d9-b676-ee464d9baebf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.290127 Aug 08 17:02:38.724975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 149/287] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:38 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:38.736836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:38.737999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:38.747335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.748319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.748972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.750291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:38.751019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:38.751891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:38.958335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:38.975949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2048da08-ad53-4e1f-8299-838195a1cabe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.248340 Aug 08 17:02:38.990879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 150/288] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:38 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:39.021544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:39.023394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:39.035870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:39.036786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:39.037823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:39.039721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:39.041602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:39.043290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:39.249121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:39.259443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f7e302dc-a015-465b-acbe-2cb35f37dd45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.246160 Aug 08 17:02:39.274540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 151/289] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:39.333752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:39.343126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:39.345102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:39.347173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-07deb2ce-d662-46c2-9328-fbc56a104e30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.762169 Aug 08 17:02:39.347753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 139/290] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:39.745614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:39.746164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:39.755209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:39.757028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:39.757471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:39.759743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:39.760212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:39.760887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:39.951573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:39.961365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eac72869-4867-4da1-8788-65dc834ec444 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.220083 Aug 08 17:02:39.962075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 152/291] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:39 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:40.007587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:40.008384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:40.015150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.015641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.050668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.050668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.050668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.050668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.256710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:40.277202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-548d9e9b-527e-4faa-9942-74884d16a1a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.273330 Aug 08 17:02:40.317258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:40.317544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 140/292] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:40 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:40.318589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:40.332485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.333690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.335305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.337071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.338518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.339579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.395088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:40.396984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:40.423078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.424846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.425306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.426368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.427851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.428657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.557040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:40.568610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c88dc3c5-d0df-4acf-b943-ae91c50e773d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.271957 Aug 08 17:02:40.586988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 153/293] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:40.652672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:40.662920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:40.664629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:40.666217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51d7650a-c2f0-41c2-a1fc-0e0a6bbff0ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.278625 Aug 08 17:02:40.667299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 141/294] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:40.989108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:40.989730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:40.996751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.997330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:40.997977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:40.998883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:40.999574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.000172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.171828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.180561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-05198796-2195-4476-953f-d9f69c59c7c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.196341 Aug 08 17:02:41.182039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 154/295] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:40 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:41.322354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:41.323591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:41.341482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.342062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.342501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.343218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.343682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.344108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.571049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.578688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a11963dc-ea18-461d-86ef-e46801bc4c78 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.261659 Aug 08 17:02:41.579275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 142/296] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:41 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:41.590531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:41.591440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:41.607896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.608334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.608774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.609565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.613208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.620767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.695413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:41.696013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:41.716196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.716777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.721673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.722607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:41.724602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:41.725133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:41.865642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.877084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3275b72e-41b2-419d-aca6-e094ddd46712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.290303 Aug 08 17:02:41.878017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 155/297] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:41.977985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.987952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.989666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:41.990868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5da686e7-6551-4d0f-90d2-54740a99c327 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.300319 Aug 08 17:02:41.992000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 143/298] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:42.204257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:42.204890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:42.212016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.212747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.213356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.214413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.215026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.215632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.385168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:42.385405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0008a449-d099-475c-a333-e5ce0344f56a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.185092 Aug 08 17:02:42.386255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 156/299] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:42 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:42.417052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d590a811-973f-4e31-8808-7471e74086a7", "name": "network-vif-plugged", "status": "completed", "tag": "39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:42.429749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.430634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.431263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.445062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] Creating event network-vif-plugged:39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9 for instance d590a811-973f-4e31-8808-7471e74086a7 on hv-cinder-85221 Aug 08 17:02:42.454853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-61d0d0ca-7a9c-4686-9f7d-057bac1387e3 req-24ae5ef1-3239-4f52-80f2-1b8eeae549e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046058 Aug 08 17:02:42.460855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 144/300] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:42.599837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:42.601144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:42.609414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.610340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.610791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.611515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.612125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.612565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.781067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:42.789254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b144964c-e0f4-4be7-85ad-4e1167f56c51 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.193402 Aug 08 17:02:42.790468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 157/301] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:42 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:42.902053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:42.902751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:42.917499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.918585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.919210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:42.921119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:42.923110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:42.923555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.014905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:43.015520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:43.021657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.022961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.023464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.024180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.024643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.025073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.094289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:43.111849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12bde108-b9ea-43c1-8205-7c6aa6d84df5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.215106 Aug 08 17:02:43.112447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 145/302] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:43.237026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:43.249655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:43.252393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:43.253756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c5f1f2b2-500e-4aa4-a97c-81fa1b74e78b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.242677 Aug 08 17:02:43.267343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 158/303] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:02:43.408670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:43.409420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:43.412080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:43.418314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.419541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.419541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.420191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.420716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.421215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.587269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:43.610166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-606c6cc4-7204-45a6-97c5-49358b456462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.204411 Aug 08 17:02:43.612428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 146/304] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:43 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:43.824586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:43.826294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:43.847404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.849234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.850289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:43.853559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:43.859687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:43.863630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.135019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:44.135651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:44.142653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.150328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.150849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.151296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.152015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.152480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.153061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.155324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-81a8307a-919f-455e-abf2-7df32b4efa7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1318 microversion: 2.1 time: 0.347404 Aug 08 17:02:44.169737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 159/305] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:43 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:44.170055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:44.282596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:44.283735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:44.291127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.292003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.292616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.293329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.293858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.294443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.309555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.317993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-030f1e5d-270f-4c7f-9747-cb929c90f8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.187005 Aug 08 17:02:44.318728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 147/306] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:44.476205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.508049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.531331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.531331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-793e5b38-87ff-4d4a-bcc2-fbd2e79207f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.245831 Aug 08 17:02:44.531331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 160/307] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:02:44.643504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:44.644158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:44.664402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.670689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.677212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.684189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:44.684683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:44.685502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:44.890685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:44.903540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-678fef11-a79a-45bb-8c40-e3305e0b005a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.265968 Aug 08 17:02:44.905103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 148/308] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:44 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:45.178002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:45.178991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:45.188489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.189355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.189839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.190586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.191046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.191473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.251509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c06d12-050a-4dbb-9d04-30953de7661e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf152b4-252b-448e-a10e-bed9b31db08b"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:45.261948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.262691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.263196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.280486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] Creating event network-vif-plugged:4bf152b4-252b-448e-a10e-bed9b31db08b for instance 97c06d12-050a-4dbb-9d04-30953de7661e on hv-cinder-85221 Aug 08 17:02:45.288013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-3289b373-4056-4729-b8dd-70158d1a6845 req-ce8d5e81-15e3-416b-9b2d-bda5b40b8e19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040102 Aug 08 17:02:45.288877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 149/309] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:45.342686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:45.343412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:45.352126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.352355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.352972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.353873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.354563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.355219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.514805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:45.523014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:45.527616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6e5838e4-550b-4998-bcb2-5c725169e418 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1506 microversion: 2.1 time: 0.354161 Aug 08 17:02:45.541833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 161/310] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:45 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:45.551792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb7c44f0-31e9-454e-aca0-32c226780fb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.215216 Aug 08 17:02:45.568088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 150/311] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:45.568286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:45.568778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:45.601209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.601209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.601209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.604891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.605639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.606975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.929690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:45.930555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:45.946899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.947408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.949616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.950004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:45.952823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:45.954613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:45.959206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:45.972486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:45.974451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:45.978850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-30c649ca-6326-4cde-8de9-6b9b7db4a54a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.417129 Aug 08 17:02:45.979766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 162/312] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:46.279547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:46.288714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27bed002-d33e-47c2-a07a-71fe734dbb64 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.363415 Aug 08 17:02:46.290534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 151/313] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:45 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:46.585365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:46.589188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:46.597218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:46.597820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:46.598299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:46.599042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:46.599500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:46.599923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:46.962298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:46.962298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-859a6e7d-f264-4139-95e4-d6d4c725bc40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.325111 Aug 08 17:02:46.962298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 163/314] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:47.006704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:47.046334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:47.046334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.046334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.046334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:47.046760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.046760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.046760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:47.198713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:47.213038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:47.214668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:47.216126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-266777d1-4f89-4cc9-b436-efee5cc73546 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.213211 Aug 08 17:02:47.230281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 152/315] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:47.314469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:47.320026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:47.321769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.322335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.322783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:47.323505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.323989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.324625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:47.329747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:47.591213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:47.601678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d5e36b3d-c041-4818-8016-0ce0c70622e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.291172 Aug 08 17:02:47.602037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 164/316] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:47 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:47.964423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:47.967973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:47.971890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.972381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.972814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:47.973779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:47.974710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:47.976220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:48.242346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:48.242887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:48.257086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:48.257583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:48.258048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:48.258761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:48.259217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:48.259644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:48.264254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:48.273636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2cf6f179-20e9-4499-976b-32d6a38fb00e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.312933 Aug 08 17:02:48.274935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 153/317] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:48.458723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:48.470651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:48.472754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:48.474638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9bf5582d-3c27-4890-a43f-7a5c90143a93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.237878 Aug 08 17:02:48.476078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 165/318] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:02:48.633337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:48.634110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:48.642181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:48.643151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:48.643778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:48.644676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:48.645360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:48.646106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:48.901619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:48.910060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a5b9448-8556-4b56-8f5b-41ff4aaf6f00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.286093 Aug 08 17:02:48.910634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 154/319] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:48 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:49.297560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:49.298893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:49.308116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.308621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.309281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:49.310094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.315116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.315116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:49.504527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:49.516313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:49.520473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:49.526194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0d3a398c-4dca-4ce3-a4c9-7b51bfc02041 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.232688 Aug 08 17:02:49.527250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 166/320] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:49.529543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.530066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.530728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:49.531839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.535071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.535863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:49.748382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:49.761701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:49.763332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:49.764566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e333a273-b497-44b4-b001-bab2ac897c4d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.268511 Aug 08 17:02:49.785606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 155/321] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:49.933828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:49.934559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:49.945001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.945598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.946325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:49.947618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:49.948383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:49.957184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:50.149480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:50.159387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ffdc2212-5489-42d1-94bb-99c48935ba34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.230254 Aug 08 17:02:50.159969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 167/322] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:49 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:50.554639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:50.561083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:50.568034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:50.568524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:50.569186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:50.570080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:50.570805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:50.571376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:50.791589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:50.792517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:50.800962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:50.801740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:50.802607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:50.804419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:50.805095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:50.805708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:50.815746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:50.826910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00e477e4-09ee-4935-92ed-d0e9fb1374b9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.282186 Aug 08 17:02:50.828956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 156/323] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:51.002603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:51.017473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:51.021442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:51.025147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8d932253-7779-4654-a6a5-5da5fc0192db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.235125 Aug 08 17:02:51.025761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 168/324] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:51.193046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:51.193046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:51.193046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:51.193046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:51.193428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:51.193428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:51.193428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:51.193428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:51.229676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5942a99b-67e9-416e-96d5-b9f6af172b2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Action: 'create', calling method: .version_select at 0x7f74392a3940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1422761939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8cxGV/p+hXGQy7olupvKQsl2z8NTzcwGh1QAUlUrknmJRQq9y7Kn46tMp/4FbPddMav64lgAshdsjIliIX4pbutj4Wd8OknXDOb6UXzVSfZ219quaw/PReAjdvET0E+g=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:51.249531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-5942a99b-67e9-416e-96d5-b9f6af172b2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Getting quotas for project 42851a2730ad4d749d5e33d44ea607e6. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:02:51.258327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-5942a99b-67e9-416e-96d5-b9f6af172b2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Getting quotas for user 9563998855204d3881af170730f04a34 and project 42851a2730ad4d749d5e33d44ea607e6. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:02:51.357123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:51.365009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c530d0be-994b-4084-9762-454bb9c56a90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.186895 Aug 08 17:02:51.365584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 169/325] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:51 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:51.380229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5942a99b-67e9-416e-96d5-b9f6af172b2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.402294 Aug 08 17:02:51.380997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 157/326] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:02:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:02:51.848728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:51.849449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:51.857943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:51.858821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:51.859324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:51.860254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:51.860798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:51.861446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:52.017053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:52.024905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5b82495b-3f39-480f-af7f-413d2e547187 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1363 microversion: 2.1 time: 0.180300 Aug 08 17:02:52.025457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 170/327] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:52.050920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:52.052289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:52.061271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:52.062397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:52.062927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:52.063855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:52.064488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:52.064993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:52.216234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:52.225024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:52.227241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:52.228429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2b7f80bf-574e-4039-911b-d03b6e15f5f4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.183498 Aug 08 17:02:52.228979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 158/328] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:52.385927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:52.386538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:52.392662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:52.393145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:52.393588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:52.394309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:52.394983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:52.395408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:52.560029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:52.568519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-33e24385-8bf0-4acd-a963-6fd3ea898d37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.185682 Aug 08 17:02:52.569596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 171/329] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:52 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:53.052264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:53.054796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:53.065627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.067278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.068104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.069145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.072514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.073360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.239513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:53.247853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae01c22d-329a-4f6f-b65e-5571894ed5af tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1552 microversion: 2.1 time: 0.203213 Aug 08 17:02:53.259394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 159/330] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:53.260216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:53.260216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:53.260216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.260216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.260867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.260867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.260867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.260867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.268112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:53.268647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:53.275804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.276374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.276902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.277656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.278249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.278671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.379836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e9166b8-36ce-4080-a3af-e02611e90375 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115491 Aug 08 17:02:53.380647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 160/331] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:02:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:02:53.412657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:53.422609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:53.424362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:53.425703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-91b18b03-304d-4e12-b4df-14b581443ff8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.178957 Aug 08 17:02:53.426465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 172/332] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:02:53.592417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:53.593260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:53.603974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.604561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.605004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.605827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:53.606298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:53.606688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:53.929561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:53.944730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6a947916-735e-4936-a97c-b25c3c2f0719 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.356219 Aug 08 17:02:53.945324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 161/333] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:53 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:54.467319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:54.472596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:54.489248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:54.491038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:54.492737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:54.494303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:54.496182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:54.497318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:54.683597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:54.693014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:54.695218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:54.696417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0df49fdd-90cd-4b83-97d8-9b089b00a298 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.250842 Aug 08 17:02:54.696976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 173/334] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:54.956042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c06d12-050a-4dbb-9d04-30953de7661e", "tag": "4bf152b4-252b-448e-a10e-bed9b31db08b"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:54.966350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:54.966964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:54.973932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:54.974410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:54.974538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:54.974838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:54.974947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:54.975416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:54.976108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:54.976905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:54.977566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:54.991411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] Creating event network-changed:4bf152b4-252b-448e-a10e-bed9b31db08b for instance 97c06d12-050a-4dbb-9d04-30953de7661e on hv-cinder-85221 Aug 08 17:02:55.002677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-d3eef423-e36f-47ec-86e4-6fdec0452ce7 req-001f4afe-7a35-4e70-942f-4fe252c1dba7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050264 Aug 08 17:02:55.003724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 162/335] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:55.190669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:55.202653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-83ced4a9-2b2e-4e17-9b84-cdea6f86d41e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.239819 Aug 08 17:02:55.216549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 174/336] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:54 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:55.723879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:55.724587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:55.731843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:55.732329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:55.732765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:55.733502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:55.733996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:55.734587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:55.887437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:55.896310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:55.898547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:55.899842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-544a2d1a-076c-47dd-b226-cb781cad0619 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.183047 Aug 08 17:02:55.902134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 163/337] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:56.227260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:56.227869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:56.234338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:56.234823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:56.235445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:56.236146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:56.236598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:56.237022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:56.370653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:56.378557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e9017895-5766-4482-9992-15445fb16f34 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.155580 Aug 08 17:02:56.379169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 175/338] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:56 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:56.925949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:56.926574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:56.933069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:56.933718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:56.934195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:56.934905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:56.935362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:56.935812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:57.079185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:57.089078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:57.090666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:57.092197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38164817-8c36-440e-af38-e04ae3e7da1b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.170124 Aug 08 17:02:57.093215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 164/339] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:57.400910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:57.401602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:57.408789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:57.409274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:57.409713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:57.410489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:57.410966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:57.411394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:57.547539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:57.555601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c6ee62e2-a1b7-4c1d-a4f3-1485f1e79a32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.158827 Aug 08 17:02:57.556166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 176/340] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:57 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:58.115343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:58.115993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:58.126560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:58.127056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:58.127495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:58.128214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:58.128667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:58.129092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:58.260812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:58.269376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:58.270931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:58.272102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-287b169a-e353-4ffa-9972-2fa085e34d8f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.160802 Aug 08 17:02:58.273444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 165/341] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:58.576378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:58.577074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:58.583487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:58.583975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:58.584415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:58.585693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:58.586178 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:58.586604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:58.715066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:58.722435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-24c48d12-69ab-433c-8909-5760e2869739 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.149954 Aug 08 17:02:58.723003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 177/342] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:58 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:59.298429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:59.300062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:59.307879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:59.311708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:59.311708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:59.311708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:59.311708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:59.312054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:59.332314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:59.453416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:59.462205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:59.463700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:59.464862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11d26c3e-b508-4829-8570-36ea32da498d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.171577 Aug 08 17:02:59.465400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 166/343] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:59.742751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:59.745772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:59.751866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:59.758757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:59.758757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:59.758757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:59.758757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:59.759165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:59.890057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:59.898454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cc7adaa9-73f6-46fa-b06e-dcb549cf5063 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.159530 Aug 08 17:02:59.899084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 178/344] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:59 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:00.487077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:00.487691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:00.495099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:00.495896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:00.497106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:00.498111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:00.498749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:00.499186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:00.640305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:00.648547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:00.650146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:00.651360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7142b01c-fa33-43a1-a1a8-faa3c2b784a2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1722 microversion: 2.20 time: 0.168330 Aug 08 17:03:00.651919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 167/345] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:00.920475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:00.921004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:00.923495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=84 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:00.928301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:00.929419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:00.929888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:00.934282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:00.934282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:00.934282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:01.064594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:01.074149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9df392b-9b13-4a87-91be-06d862dcf645 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.157431 Aug 08 17:03:01.074975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 179/346] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:00 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:01.675614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:01.676386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:01.678973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:01.685321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:01.685866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:01.686425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:01.687229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:01.687850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:01.688308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:01.843646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:01.852383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:01.853919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:01.855086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-61bcaf13-b646-4705-824f-730480327009 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1743 microversion: 2.20 time: 0.183827 Aug 08 17:03:01.855634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 168/347] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:02.098015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:02.098621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:02.124362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:02.124870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:02.125318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:02.127153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:02.127829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:02.128431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:02.294651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:02.298405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:02.303235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07a096bd-ceb5-4323-9a4b-4a0eb35152ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.210487 Aug 08 17:03:02.303799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 180/348] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:02 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:02.879781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:02.880878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:02.889961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:02.890958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:02.893968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:02.897211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:02.897805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:02.898249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:03.045932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:03.055414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:03.057181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:03.059051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3c11910-fa5c-4428-9704-826917657159 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1743 microversion: 2.20 time: 0.184079 Aug 08 17:03:03.059611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 169/349] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:03.324568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:03.325766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:03.333059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:03.333546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:03.333905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:03.335102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:03.335727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:03.336324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:03.482049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:03.499520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bf33c9a2-845e-4e7c-9412-07c28a6de377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.178790 Aug 08 17:03:03.500485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 181/350] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:03 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:04.082654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:04.083192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:04.089248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:04.097884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:04.097884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:04.097884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:04.097884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:04.098253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:04.228171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:04.237162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:04.238815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:04.240168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-466b0252-956c-4a04-96a4-a3a8c2ef0330 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1743 microversion: 2.20 time: 0.161405 Aug 08 17:03:04.240720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 170/351] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:04.521272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:04.521917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:04.528467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:04.528949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:04.529382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:04.530212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:04.530666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:04.531110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:04.674514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:04.687807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-375af47f-cda3-4959-bed6-a83b1e731566 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.170349 Aug 08 17:03:04.702062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 182/352] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:04 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:04.789232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "name": "network-vif-plugged", "status": "completed", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:04.799232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:04.799723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:04.800173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:04.811611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] Creating event network-vif-plugged:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:03:04.816574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-c1894d3f-655a-400a-ba17-b0bbaccd98cc req-391430be-fcef-424c-a711-9e7e0f033cf9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031848 Aug 08 17:03:04.817151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 171/353] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:05.263605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:05.264207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:05.270261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:05.270747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:05.271184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:05.271876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:05.272965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:05.273391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:05.403776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:05.411690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:05.413183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:05.414370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-801ad333-8854-4909-a7ce-dfa1a30da433 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.154787 Aug 08 17:03:05.414919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 183/354] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:05.709119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:05.709884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:05.716020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:05.716544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:05.716922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:05.717604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:05.718072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:05.718495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:05.855737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:05.863141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-01a14369-b51e-4e1e-a6fd-8923f4cf7364 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.158309 Aug 08 17:03:05.863745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 172/355] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:05 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:06.436800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:06.437419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:06.444048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:06.444622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:06.445070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:06.446411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:06.446411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:06.449258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:06.592796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:06.602114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:06.603714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:06.604911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0ce7dc5e-4ee6-41af-b739-d08cf087d8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.172030 Aug 08 17:03:06.605577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 184/356] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:06.885525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:06.886163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:06.892048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:06.892560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:06.892971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:06.893668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:06.894167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:06.894595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:07.043534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:07.051098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-179e62fb-f1c8-4d39-8191-cd146fc84f41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.169896 Aug 08 17:03:07.051659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 173/357] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:06 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:07.627877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:07.628420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:07.635830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:07.636374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:07.636823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:07.637541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:07.638047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:07.638468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:07.772522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:07.784629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:07.786190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:07.787350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-617fb630-0c36-4d3b-a564-587911c8568e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.163749 Aug 08 17:03:07.787904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 185/358] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:08.072601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:08.073217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:08.079173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:08.079663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:08.080097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:08.080787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:08.081239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:08.081661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:08.219209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:08.226775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce0b87c9-d3fd-4769-847e-fc87cd0f5925 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.158069 Aug 08 17:03:08.227341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 174/359] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:08 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:08.810721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:08.811327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:08.817738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:08.818255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:08.818687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:08.819371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:08.820444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:08.820884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:08.948605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:08.956902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:08.958416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:08.959772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2029a6ae-2886-4931-8854-3915557d02d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.152963 Aug 08 17:03:08.960522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 186/360] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:09.248837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:09.249449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:09.255485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:09.255971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:09.256409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:09.257094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:09.257555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:09.258017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:09.394115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:09.402034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f863aa87-a1ba-425c-aa4c-d841e17e7078 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.157090 Aug 08 17:03:09.402588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 175/361] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:09 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:09.981847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:09.982460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:09.988823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:09.989309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:09.989745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:09.990466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:09.990921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:09.991349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:10.125945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:10.134442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:10.135997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:10.137113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4c1c9219-706b-4205-965c-7f43d8556b7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.159189 Aug 08 17:03:10.137669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 187/362] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:10.423793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:10.424405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:10.430441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:10.431922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:10.432585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:10.433275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:10.433731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:10.434182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:10.574071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:10.581537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f621837c-4e73-4511-b643-027f353d806b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.161640 Aug 08 17:03:10.582141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 176/363] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:10 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:11.159528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:11.160089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:11.167101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:11.167595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:11.168029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:11.168719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:11.169175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:11.169600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:11.302180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:11.311301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:11.312900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:11.314091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1b870a68-1367-413f-a89c-e3f45a18dff0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.158705 Aug 08 17:03:11.314676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 188/364] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:11.605330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:11.606009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:11.612713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:11.613107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:11.613541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:11.614312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:11.614716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:11.615137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:11.746958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:11.756935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3986fce-0f85-4281-9729-ba7951000790 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.155790 Aug 08 17:03:11.758852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 177/365] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:11 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:12.338358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:12.339025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:12.347189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:12.347189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:12.347189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:12.347189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:12.347624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:12.348055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:12.479852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:12.488452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:12.489976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:12.491126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-34578775-d592-4a18-8d48-7c4502c3c237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.156737 Aug 08 17:03:12.491682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 189/366] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:12.779785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:12.780406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:12.786411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:12.786881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:12.787316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:12.788063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:12.788511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:12.788930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:12.929032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:12.937443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f81f58bc-87c6-4467-b4d3-d6b36935b6ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.161461 Aug 08 17:03:12.938056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 178/367] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:12 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:13.515121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:13.515708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:13.522133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:13.522620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:13.523052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:13.523738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:13.524188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:13.525163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:13.661148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:13.669288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:13.670817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:13.671960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-665cb435-b5a6-478d-971f-a8abc482d249 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.161308 Aug 08 17:03:13.672515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 190/368] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:13.958246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:13.958868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:13.964897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:13.965378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:13.965839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:13.966534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:13.966989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:13.967414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:14.099056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:14.107004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-da3e02ad-64be-4b4e-a447-96db431b7040 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.152520 Aug 08 17:03:14.107564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 179/369] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:13 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:14.694613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:14.695146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:14.701673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:14.702377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:14.702816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:14.703545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:14.703996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:14.704419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:14.837563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:14.849839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:14.850394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:14.851883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-319c25d9-d798-46f6-9f89-a0d9faebcaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.161494 Aug 08 17:03:14.853556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 191/370] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:15.127910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:15.128518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:15.130648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:15.135823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:15.136302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:15.136735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:15.137511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:15.138067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:15.138591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:15.277815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:15.285550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae725753-1469-4c45-a1d0-b2c463accce6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.161507 Aug 08 17:03:15.286152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 180/371] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:15 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:15.876569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:15.877173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:15.883121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:15.883600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:15.884040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:15.884732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:15.885182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:15.885605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:16.017749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:16.026793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:16.028430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:16.029592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4394e021-d1a7-48fe-8352-68cdc18521d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.157175 Aug 08 17:03:16.030177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 192/372] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:16.306270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:16.306882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:16.312868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:16.313419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:16.313901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:16.314688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:16.315087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:16.315512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:16.445927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:16.453825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7482fda-3298-4728-acab-e89c86a993d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.151801 Aug 08 17:03:16.454385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 181/373] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:16 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:17.059799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:17.064861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:17.068497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:17.069080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:17.069593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:17.070401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:17.070857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:17.071290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:17.203994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:17.212242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:17.213871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:17.215119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cc7c9cff-1fbc-41b0-a3a9-848357f16804 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.160295 Aug 08 17:03:17.215683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 193/374] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:17.475155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:17.475758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:17.484231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:17.484722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:17.485150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:17.485923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:17.486374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:17.486819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:17.622866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:17.640675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b53d5ded-16b4-4824-b7b8-0eff12afad52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.169247 Aug 08 17:03:17.641245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 182/375] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:17 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:18.238586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:18.239212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:18.246336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:18.246811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:18.247239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:18.247921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:18.248370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:18.248790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:18.381323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:18.389838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:18.391322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:18.392471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cf80fd07-4549-4858-8ae6-40dca8fcf535 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.157765 Aug 08 17:03:18.393056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 194/376] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:18.662096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:18.662847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:18.669162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:18.669658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:18.670133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:18.671146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:18.671298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:18.671726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:18.803480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:18.807074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:18.811364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f543b13-b1b9-464c-9f3e-06b2993e2a81 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.153155 Aug 08 17:03:18.812024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 183/377] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:18 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:19.415998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:19.416563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:19.423136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:19.423624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:19.424082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:19.424783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:19.425241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:19.425665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:19.562853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:19.570687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:19.572209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:19.573350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6a2b193d-6e44-4737-ad9b-2db3ce2ce5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.162202 Aug 08 17:03:19.573918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 195/378] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:19.831894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:19.832535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:19.839511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:19.840001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:19.840429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:19.841109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:19.841559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:19.842028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:19.973367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:19.981482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c45fd63-75ee-44c1-a14c-47976262074c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.153438 Aug 08 17:03:19.982188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 184/379] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:19 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:20.597252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:20.598110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:20.606270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:20.606920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:20.607395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:20.608460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:20.609248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:20.609747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:20.742798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:20.751316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:20.752833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:20.754039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-49b1471a-f64c-41c6-b83b-daa6366e4a66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.161749 Aug 08 17:03:20.754530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 196/380] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:21.002658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:21.003386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:21.010234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:21.010783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:21.011273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:21.012109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:21.012632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:21.013219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:21.147850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:21.155894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4391bc87-cc5e-496e-8352-ff79c86cc638 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.157187 Aug 08 17:03:21.156502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 185/381] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:20 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:21.780188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:21.780791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:21.790493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:21.791336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:21.791776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:21.792468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:21.792922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:21.793347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:21.811663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:21.927213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:21.935742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:21.937284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:21.938463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2de4797d-c79f-4697-8405-076b5f2a448e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.163932 Aug 08 17:03:21.939017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 197/382] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:22.178518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:22.179132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:22.185770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:22.186301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:22.186736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:22.187423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:22.187874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:22.188297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:22.321428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:22.329254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64494f56-e4c1-45fa-b22f-1b0731cbc23d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.154682 Aug 08 17:03:22.329848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 186/383] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:22 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:22.961875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:22.963153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:22.971236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:22.977390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:22.977390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:22.977390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:22.977390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:22.977769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:23.120966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:23.128671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:23.130207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:23.131393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4d1102e4-bf9f-4350-907b-a61a609096c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.173614 Aug 08 17:03:23.146433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 198/384] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:23.362794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:23.362794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:23.362794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:23.362794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:23.363619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:23.363619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:23.363619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:23.363619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:23.491093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:23.502344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1d8b72f1-22c8-461e-a1b8-f6c79abbee7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.155305 Aug 08 17:03:23.502928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 187/385] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:23 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:24.155669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:24.156448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:24.163040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:24.163522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:24.163956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:24.164644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:24.165101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:24.165781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:24.298142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:24.306151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:24.307640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:24.309177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2d82c325-519d-4e59-9d9b-672c4714f961 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.157375 Aug 08 17:03:24.309927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 199/386] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:24.523521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:24.524137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:24.530923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:24.531445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:24.531880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:24.532568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:24.533025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:24.533450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:24.954521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:24.962023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9840aa60-0e4c-428b-91b1-42f62dae400a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.442294 Aug 08 17:03:24.962596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 188/387] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:24 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:25.331558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:25.332090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:25.339085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:25.339893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:25.341157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:25.342112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:25.342761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:25.343360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:25.504920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:25.513762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:25.515522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:25.516759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e980b07e-8519-4a7d-b858-1acb556e3e8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.189110 Aug 08 17:03:25.517317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 200/388] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:25.983751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:25.984962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:25.991492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:25.991984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:25.992421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:25.993302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:25.993761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:25.994217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:26.172978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:26.220567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-06328de3-2ae6-4b6d-a79f-b0a25ce81866 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.241014 Aug 08 17:03:26.235339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 189/389] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:25 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:26.546406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:26.547725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:26.557618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:26.558166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:26.558595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:26.559845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:26.560437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:26.560862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:26.737943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:26.748647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:26.750485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:26.751382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eda41e61-056b-46f8-9fc7-ef73a1261451 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.215023 Aug 08 17:03:26.766578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 201/390] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:27.255718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:27.256450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:27.264034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.264733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.265294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.266162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.266761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.267331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.453486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:27.462577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bf75e687-c922-40e9-be98-8b507bdf8259 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.220389 Aug 08 17:03:27.469824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 190/391] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:27 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:27.774439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:27.775192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:27.782177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.782662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.783109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.783824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.784288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.784718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.941000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:27.949266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:27.950943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:27.952162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-743127e0-92e0-4549-bb25-164000b67a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.181827 Aug 08 17:03:27.952978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 202/392] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:28.485551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:28.487659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:28.494725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.495427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.496063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.496796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.497434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.498057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.650641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:28.659835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3b1877f5-a69e-4785-923b-025bf4417029 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1502 microversion: 2.1 time: 0.178874 Aug 08 17:03:28.673155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 191/393] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:28 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:28.692335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c9b2d3-f85e-4cb1-9c81-04eb8322c40c"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:28.695598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:28.708065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.708863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.709466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.710391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.716077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.716077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.738488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Cannot 'attach_volume' instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d while it is in vm_state rescued Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/os-volume_attachments HTTP/1.1 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 74 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:03:28.740491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {"volumeAttachment": {"volumeId": "a8c9b2d3-f85e-4cb1-9c81-04eb8322c40c"}} Aug 08 17:03:28.742173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Cannot 'attach_volume' instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d while it is in vm_state rescued Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '3506c2e4-aa88-4ed1-aa43-8d51b419907d', 'body': {'volumeAttachment': {'volumeId': 'a8c9b2d3-f85e-4cb1-9c81-04eb8322c40c'}}} Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:03:28.743118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d while it is in vm_state rescued Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:03:28.744499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:03:28.745760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:03:28.745760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:03:28.745760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d while it is in vm_state rescued Aug 08 17:03:28.745760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:03:28.746769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 409 to user: Cannot 'attach_volume' instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d while it is in vm_state rescued {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:03:28.747909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d6928a39-298b-4d29-9599-9864e6582438 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060143 Aug 08 17:03:28.748795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 203/394] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:03:28 2022] POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 17:03:28.757891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:28.762602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:28.767199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.768081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.768727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.769679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.770429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.771033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.976744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:28.978159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:28.986329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.987250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.989575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.993967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.994672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.995131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:29.024979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-733647f0-08e0-4264-9771-8086c41a8535 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/action" status: 202 len: 0 microversion: 2.1 time: 0.271207 Aug 08 17:03:29.032007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 192/395] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:03:28 2022] POST /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:03:29.063267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:29.068667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:29.086718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:29.091757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:29.092522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:29.093284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:29.094531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:29.094531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:29.192969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:29.205520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:29.211526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:29.212030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-43f15b4b-462d-4302-88fb-ba1bcba5d750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.239914 Aug 08 17:03:29.213196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 204/396] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:29.348717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:29.362333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a79f8a42-53e3-4965-b5b3-93a9116795c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1510 microversion: 2.1 time: 0.325264 Aug 08 17:03:29.362926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 193/397] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:29 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:30.241518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:30.242339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:30.250031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:30.251232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:30.251978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:30.253195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:30.254693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:30.255680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:30.384310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:30.385115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:30.401551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:30.404568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:30.404944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:30.415611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:30.416423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:30.416542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:30.498592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:30.509528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:30.511674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:30.519839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2dbd59b8-0699-4dc4-b32b-461c24e17fab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.282256 Aug 08 17:03:30.532437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 205/398] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:30.579864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:30.588303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-96f857fa-811c-4aab-b4ae-ebe2180bc801 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1510 microversion: 2.1 time: 0.207799 Aug 08 17:03:30.589260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 194/399] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:30 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:31.550076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:31.550672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:31.552977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=54 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:31.557858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.558341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.559268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.560006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.560458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.561100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.613530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:31.614308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:31.621064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.622397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.622964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.631479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.631479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.631479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.705033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:31.713350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:31.714955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:31.716366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7f02a46e-aadb-4b9d-9497-30661bac8c60 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.173689 Aug 08 17:03:31.716887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 206/400] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:31.770900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:31.779103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dd8a715d-7793-4beb-a433-a117721414a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1510 microversion: 2.1 time: 0.169698 Aug 08 17:03:31.779673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 195/401] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:31 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:32.739878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:32.743249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:32.748776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.749360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.749963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.750778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.751343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.751869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.803391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:32.804623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:32.812065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.813260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.813974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.817608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.818662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.819097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.905998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:32.916151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:32.917834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:32.919153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b956aca0-5acc-418b-8b1d-b5abb562b70c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.183522 Aug 08 17:03:32.920020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 207/402] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:32.984908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:32.993353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81595fc5-b212-4d15-856b-e17eea4795e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1510 microversion: 2.1 time: 0.194096 Aug 08 17:03:32.994030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 196/403] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:32 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:33.942422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:33.943880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:33.951754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:33.952255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:33.952700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:33.953402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:33.953888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:33.954319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:34.014457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:34.017334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:34.022305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:34.023033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:34.023690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:34.024622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:34.025235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:34.025842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:34.146160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:34.158186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:34.159842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:34.163633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f8c20300-b613-4b77-96e4-1b7b839b56d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.222738 Aug 08 17:03:34.178565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 208/404] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:34.197899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:34.209548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68849873-951b-4de8-a9b1-a66e8119d70c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1516 microversion: 2.1 time: 0.198815 Aug 08 17:03:34.210456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 197/405] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:34 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:35.184933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:35.185541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:35.192379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:35.192865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:35.193301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:35.194028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:35.194485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:35.194911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:35.352498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:35.364624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:35.366206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:35.370294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f08fa344-a257-4696-ae55-f2909402c0a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.189296 Aug 08 17:03:35.371414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 209/406] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:36.396797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:36.397570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:36.405044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:36.405531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:36.406023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:36.406764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:36.407239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:36.407659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:36.567393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:36.570221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: .version_select at 0x7f743897d4c0>, body: {"keypair": {"name": "tempest-keypair-1500971594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWEgzr4oomtTftNaUdbKiEg9P9bVawJg3JpXEZ5P2pKCGo9QtTWdvV1ARM+zG2s6K5+yQmrAiaoHmXQQlF6Bh/nOyv6AEQYzYTcs1LZ5OrACmEp74nQ+pz4L9FNtE92Wg=="}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:36.576909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:36.578644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:36.579823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e59b5742-539c-4f88-b327-cb6d6a165865 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1738 microversion: 2.20 time: 0.187683 Aug 08 17:03:36.580455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 198/407] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:36.598245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:03:36.602613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for user d6e9bd6db85b4decbdac1908912d158c and project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:03:36.616290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [858cf4b9-9182-4d99-99bd-04e413092505] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 17:03:37.603980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:37.604715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:37.611347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:37.611833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:37.612297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:37.613032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:37.613492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:37.613956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:37.625166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [858cf4b9-9182-4d99-99bd-04e413092505] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48438. Aug 08 17:03:37.633419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:37.707330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-20a6356a-ca29-49d4-8724-05c6c02665af tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.140879 Aug 08 17:03:37.709465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 210/408] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:03:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:37.754757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:37.763233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:37.764771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:37.765974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40a2e15f-fee3-43d9-a252-b9cebd7bbf33 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1720 microversion: 2.20 time: 0.165889 Aug 08 17:03:37.766702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 199/409] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:38.789711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:38.790546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:38.797471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:38.798000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:38.798820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:38.799150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:38.799612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:38.800073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:38.932877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:38.941661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:38.944202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:38.944996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b7f46428-0f92-490d-8252-8ff21cb3b3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1720 microversion: 2.20 time: 0.160107 Aug 08 17:03:38.945555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 211/410] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:39.969353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:39.969995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:39.976585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:39.977071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:39.977508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:39.978273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:39.978728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:39.979155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:40.119019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:40.127022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:40.128525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:40.129727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3ce47924-b3e4-4cc8-980d-47d7f7ca79fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1720 microversion: 2.20 time: 0.165288 Aug 08 17:03:40.130398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 200/411] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:40.383981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1350739152", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddc292a-97ef-4b98-ab3c-917361883f99"}], "security_groups": [{"name": "tempest-securitygroup--1189689519"}], "key_name": "tempest-keypair-1500971594", "user_data": "}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:40.489718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.network.neutron [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] validate_networks() for [('bddc292a-97ef-4b98-ab3c-917361883f99', None, None, None, None, None)] {{(pid=130500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:03:40.891844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:03:40.892280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:03:40.892792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Flavor pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:03:40.893209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Image pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:03:40.893629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:03:40.902401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:40.902892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:40.903711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:40.904522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:40.904991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:40.905421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:40.923595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:03:40.927653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Getting quotas for user d6e9bd6db85b4decbdac1908912d158c and project 1a3cc7413c0c4603a7898fd5b0d6a765. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:03:40.942686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Going to run 1 instances... {{(pid=130500) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:03:40.945047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:03:40.983809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:40.994513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:40.995151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:40.995459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:41.009154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] Creating event network-vif-unplugged:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:03:41.014642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-685e3b35-aeb4-4aae-9517-006cac9cc85b req-848bbb07-7214-4164-8fc6-c4e6542f459e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035622 Aug 08 17:03:41.018209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 201/412] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:41.153590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:41.154304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:41.156785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8439f9d-6d48-4a1a-bf82-2b816db1ab02 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.776990 Aug 08 17:03:41.158647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 212/413] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:03:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:03:41.164416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:41.164416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:41.164416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:41.164416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:41.164696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:41.164696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:41.170904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff34f04b-8e56-46d1-9a28-dcdc54cb25a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:41.171526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff34f04b-8e56-46d1-9a28-dcdc54cb25a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:41.230658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ff34f04b-8e56-46d1-9a28-dcdc54cb25a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:41.239298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff34f04b-8e56-46d1-9a28-dcdc54cb25a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1246 microversion: 2.1 time: 0.072767 Aug 08 17:03:41.239968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 213/414] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:41.304089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:41.312322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:41.313927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:41.315098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5f9d04a4-47bc-4bb0-aa2a-a7270f357375 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1720 microversion: 2.20 time: 0.166322 Aug 08 17:03:41.315650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 202/415] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:42.259832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:42.260447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:42.266914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.267409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.267844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:42.268538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.273386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.273386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:42.332723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:42.338291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:42.339206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:42.340510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bf1f1751-f0f3-4743-971b-a9ea09f61be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1250 microversion: 2.1 time: 0.084582 Aug 08 17:03:42.341135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 214/416] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:42.345364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.345873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.346307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:42.346996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.347446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.347866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:42.492747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:42.501626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:42.503224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:42.504403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc50ce30-1735-40b9-a1dd-ae3e903dbfe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1723 microversion: 2.20 time: 0.169921 Aug 08 17:03:42.505027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 203/417] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:42.526859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b31be6f5-ccb0-460d-b0a9-7d1308c4344b"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:42.529420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:42.536775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.536775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.536775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:42.537337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:42.537959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:42.538388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:43.230811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:43.360626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:43.361181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:43.367336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:43.367728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:43.368158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:43.368846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:43.369316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:43.370017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:43.436295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:43.445664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-785b3ec0-66c7-4d91-89c6-d52283f2d344 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1298 microversion: 2.1 time: 0.088900 Aug 08 17:03:43.446431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 204/418] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:43.728924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ce2e3a43-2b47-4182-a719-5b971d68a5fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.205635 Aug 08 17:03:43.730249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 215/419] 10.222.0.57 () {62 vars in 1364 bytes} [Mon Aug 8 17:03:42 2022] POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 188 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:03:43.855301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:43.856543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:43.863095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:43.863664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:43.864188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:43.864931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:43.865386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:43.868639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:43.919147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130501) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 17:03:44.399361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf9bde1d-7f9b-4eee-956d-2f4e33cfd0fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action" status: 202 len: 0 microversion: 2.20 time: 0.548442 Aug 08 17:03:44.400049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 205/420] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Aug 8 17:03:43 2022] POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:03:44.409003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:44.409530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:44.425934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:44.425934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:44.425934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:44.425934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:44.426389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:44.426389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:44.467829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:44.468679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:44.477087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:44.477087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:44.477504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:44.478403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:44.478859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:44.479286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:44.578500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:44.587328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccaef6d6-5025-45f5-a3e7-9418f8d2dc9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1306 microversion: 2.1 time: 0.123845 Aug 08 17:03:44.590666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 206/421] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:44.656641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:44.674297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:44.676686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:44.678399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-783bc53b-8cc0-4fc3-8610-1d3f77917356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1749 microversion: 2.20 time: 0.273519 Aug 08 17:03:44.690378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 216/422] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1749 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:45.617643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:45.618646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:45.631149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:45.631855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:45.632510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:45.633533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:45.634190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:45.634780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:45.705001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:45.705621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:45.712537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:45.713028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:45.713592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:45.714339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:45.715050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:45.715930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:45.816372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:45.824408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd6eee16-de70-417b-9bc1-f90ff3d6074e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.211331 Aug 08 17:03:45.825576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 207/423] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:45.942781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:45.955210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:45.959798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:45.960479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7d13ee2b-7d8b-41c4-8340-044738b01a96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1749 microversion: 2.20 time: 0.259984 Aug 08 17:03:45.961526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 217/424] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1749 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:46.009848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef93b5b8-abd6-4ddf-b826-e0636af05b96", "device": "/dev/sdb"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:46.011857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:46.019934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:46.020502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:46.021009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:46.021815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:46.022337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:46.022835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:46.595501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:46.607547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:46.608107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:46.608745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:46.627787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] Creating event network-changed:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:03:46.634224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-4b3bff04-83a4-478b-848d-47e826b61dfa req-0c0ea2ff-37c6-49ae-acd8-1cca1a43b4d8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044747 Aug 08 17:03:46.635452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 218/425] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:46.852721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:46.853435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:46.860289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:46.862139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:46.862139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:46.862139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:46.862589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:46.863038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:47.099507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5c2fca3e-dbe8-4029-b83d-57eeb62efa2b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "POST /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.084238 Aug 08 17:03:47.099507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 208/426] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:03:46 2022] POST /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7/os-volume_attachments => generated 194 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:47.099507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:47.099507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:47.101891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:47.107699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:47.108695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:47.110434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:47.112110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:47.113036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:47.113729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:47.129356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:47.142029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9a93f25f-948b-4c3a-bf58-78e7dade773a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.293972 Aug 08 17:03:47.154841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 219/427] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:47.304805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:47.317770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:47.319291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:47.320456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-33b03e3c-7f9e-40a6-acb7-263bcac2d361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1751 microversion: 2.20 time: 0.228389 Aug 08 17:03:47.321345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 209/428] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:48.165468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:48.166153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:48.176036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:48.176036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:48.176036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:48.176036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:48.176427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:48.176852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:48.334101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:48.343986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3e2dc31c-8e28-4398-93fb-e7b422051c20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.182457 Aug 08 17:03:48.344524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 220/429] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:48.350402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:48.350402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:48.353480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:48.354024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:48.354477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:48.355173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:48.355628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:48.356125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:48.499687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:48.513096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:48.517946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:48.519167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-949f75b2-3bf5-45fd-92f8-cecca48fdf50 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1751 microversion: 2.20 time: 0.177396 Aug 08 17:03:48.519722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 210/430] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:49.370087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:49.370698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:49.377510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:49.378071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:49.378509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:49.379207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:49.379726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:49.380141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:49.517675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:49.525335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f597463c-430c-46ff-937a-41a9b194bed5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.159277 Aug 08 17:03:49.525924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 221/431] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:49.544123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:49.544733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:49.551475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:49.551965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:49.552401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:49.553138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:49.553836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:49.554270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:49.701854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:49.710785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:49.712211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:49.713375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44c01445-164c-4537-8648-e75cfc3a51cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1751 microversion: 2.20 time: 0.174286 Aug 08 17:03:49.720353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 211/432] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:50.548301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:50.548857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:50.555715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:50.556201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:50.558548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:50.558548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:50.558548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:50.558548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:50.691781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:50.699445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-af816167-9f66-47fe-a866-3d1a030cd681 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.155420 Aug 08 17:03:50.700028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 222/433] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:50.742262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:50.742877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:50.750557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:50.751095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:50.751543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:50.752254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:50.752881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:50.753291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:50.891198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:50.899915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:50.901489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:50.903238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8a54321-dc71-426b-8ff5-8e6b88eee4f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.164303 Aug 08 17:03:50.904800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 212/434] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:51.719944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:51.720568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:51.723115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:51.723435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=12 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:51.729130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:51.729620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:51.730095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:51.730800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:51.731257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:51.731712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:51.872214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:51.880428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-22b53c2c-678c-4384-9756-0d098d021fb9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.164417 Aug 08 17:03:51.881307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 223/435] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:51.929899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:51.930683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:51.937520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:51.938280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:51.939147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:51.955428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:51.955428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:51.955428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:52.087677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:52.096402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:52.097972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:52.099183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-843681b5-d5de-4d4e-87de-69b261a81a56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.173434 Aug 08 17:03:52.099743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 213/436] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:52.904680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:52.905738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:52.913817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:52.914334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:52.914831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:52.915817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:52.916276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:52.916704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:53.100783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:53.109252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a77668c6-32ed-4032-80f0-0a4771dc41f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.209354 Aug 08 17:03:53.110490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 224/437] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:53.125447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:53.131943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:53.138105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:53.138607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:53.139048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:53.139773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:53.140299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:53.140746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:53.161386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:53.304924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:53.332579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:53.341769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:53.343044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-57aba8f3-9d33-4af0-8ca9-dd236253c60e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.222403 Aug 08 17:03:53.343620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 214/438] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:53.378820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "name": "network-vif-plugged", "status": "completed", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:53.389034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:53.389568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:53.390044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:53.404659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] Creating event network-vif-plugged:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:03:53.410148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-9652aedf-e221-4052-a4c6-5d33a956f325 req-310f79d0-5cd7-4ff5-ad90-b6e43f7df56b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Aug 08 17:03:53.410956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 225/439] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:03:54.132258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:54.133012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:54.142168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:54.143034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:54.143684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:54.144605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:54.145282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:54.145948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:54.302466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:54.312609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09fc2676-ec97-470a-a58d-7e6557596515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.184162 Aug 08 17:03:54.327074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 215/440] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:54.369679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:54.370382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:54.377525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:54.378032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:54.378474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:54.379245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:54.379700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:54.380124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:54.557675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2030710159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1422761939", "security_groups": [{"name": "tempest-secgroup-smoke-2005923206"}], "networks": [{"uuid": "f7dac3f0-fa40-4b8d-890d-a2dc880701b2"}], "block_device_mapping_v2": [{"uuid": "684db102-74fe-42b0-ba52-035f9ec7454e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:54.565022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:54.574506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:54.576023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:54.577228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ab7bd418-af1a-42f6-9021-999475b99bc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.212332 Aug 08 17:03:54.581863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 226/441] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:54.736049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] validate_networks() for [('f7dac3f0-fa40-4b8d-890d-a2dc880701b2', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:03:55.252702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:03:55.252702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:03:55.252702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:03:55.252702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:03:55.252702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:03:55.258049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:55.258049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:55.258049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:55.258049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:55.258357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:55.258357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:55.274552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Getting quotas for project 42851a2730ad4d749d5e33d44ea607e6. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:03:55.279661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Getting quotas for user 9563998855204d3881af170730f04a34 and project 42851a2730ad4d749d5e33d44ea607e6. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:03:55.333396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:55.334064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:55.341374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:55.341903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:55.342351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:55.343118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:55.343632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:55.346020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:55.346396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:03:55.348920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='684db102-74fe-42b0-ba52-035f9ec7454e',volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:03:55.978603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:55.988230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-01713dbb-5f94-44cd-a6c6-082a1d16b88c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.658495 Aug 08 17:03:56.002482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 227/442] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:56.007910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:56.008753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:56.015667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:56.016351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:56.016973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:56.017913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:56.018528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:56.019412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:56.168728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:56.177834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:56.183783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:56.183783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d345f263-1739-48ad-ae5e-ca6f22a52360 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.176865 Aug 08 17:03:56.183783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 228/443] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:56.292727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f910d1c4-b4b6-47f9-8637-149de7ef2070 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.738981 Aug 08 17:03:56.304970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-83b14c24-4f63-4542-9007-acc6fac04766 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:56.305593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-83b14c24-4f63-4542-9007-acc6fac04766 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:56.310173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 216/444] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:03:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:03:56.376248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-83b14c24-4f63-4542-9007-acc6fac04766 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:56.383427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-83b14c24-4f63-4542-9007-acc6fac04766 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1089 microversion: 2.1 time: 0.082483 Aug 08 17:03:56.384540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 229/445] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:57.013071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:57.013071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:57.027764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:57.028256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:57.028689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:57.029851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:57.030476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:57.030902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:57.193976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:57.204618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:57.205237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:57.218064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa10642a-0589-4d39-b163-0778582f01d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.207910 Aug 08 17:03:57.218886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 217/446] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:57.219534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:57.220049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:57.220492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:57.221223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:57.221684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:57.222144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:57.395573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:57.415292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-83b1b072-50f4-45db-8031-a3483bb7ab02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:57.415292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-83b1b072-50f4-45db-8031-a3483bb7ab02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:57.415850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:57.415850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:57.415850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-989d92c2-e8e0-413b-8f74-4956a7e81e39 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.210251 Aug 08 17:03:57.416131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 230/447] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:03:57.485280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-83b1b072-50f4-45db-8031-a3483bb7ab02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:57.493016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-83b1b072-50f4-45db-8031-a3483bb7ab02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1089 microversion: 2.1 time: 0.091514 Aug 08 17:03:57.494295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 218/448] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1089 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:03:58.239588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:58.240227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:58.246727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.247302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.247783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.248548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.249158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.249707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.384932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:58.393276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-50d1df47-0d3a-4999-b0c9-ec75b6005f72 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.157526 Aug 08 17:03:58.406508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 231/449] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:58.437107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:58.437729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:58.444360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.444781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.445216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.445974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.446426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.446851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.516143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:58.516948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:58.523208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.523844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.524294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.524984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:58.525440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:58.525880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:58.586048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:58.587257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:58.595263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9718c818-8634-4a27-baaa-1135c7ccf2f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.083304 Aug 08 17:03:58.595414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 232/450] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:58.595667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:58.597695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:58.599133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f863d9bf-7c0a-44d9-8101-b53fd75825bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.166299 Aug 08 17:03:58.613813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 219/451] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:03:59.414477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:59.415333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:59.422693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.424072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.424072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.424299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.424764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.425190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.445244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:59.581616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:59.595117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-76d9f54b-a219-4f5f-9f9e-5f043fc4ac90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.179383 Aug 08 17:03:59.595117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 233/452] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:59.622715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:59.622715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:59.626488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.626988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.627432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.628192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.628489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:59.628898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.629075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.631468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:59.649557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.649557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.649557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.649557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:59.650370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:59.650370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:59.703736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:59.712372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5bd50686-bf74-4c31-97f1-f9bf0ab6d1f8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.100264 Aug 08 17:03:59.713606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 220/453] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:59.838582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:59.847782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:59.849305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:59.850515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-062fb0bf-c68a-43b2-afb0-001b73296134 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.231012 Aug 08 17:03:59.851261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 234/454] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:03:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:04:00.612440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:00.613163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:00.619742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.620230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.620675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:00.621423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.621918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.622348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:00.737194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:00.737981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:00.744662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.745148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.745587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:00.746318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.746769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.747342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:00.763644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:00.773082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b9a0375-e78e-449b-966f-4256d9021de7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.164461 Aug 08 17:04:00.774340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 221/455] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:00.820129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:00.827948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e0161d93-50fe-43b1-8c39-27b1b6bc0eda tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.094672 Aug 08 17:04:00.828493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 235/456] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:00.874678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:00.875267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:00.881857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.882361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.882800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:00.883511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:00.883990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:00.884412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:01.038333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:01.053629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:01.055196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:01.056397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1fa5dafa-60b7-44e8-8832-6ce8563a5b5d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.185985 Aug 08 17:04:01.056965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 222/457] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:01.798261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:01.799645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:01.807822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:01.808316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:01.809885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:01.809885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:01.811281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:01.812969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:01.849930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:01.850498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:01.857899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:01.858391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:01.858823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:01.859526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:01.859973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:01.860391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:01.952805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:01.962678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-98b29a56-6479-4711-9858-9edb23b873ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.116666 Aug 08 17:04:01.963290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:01.963622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 223/458] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:01.972046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-54b7f13d-142d-46c6-9ede-d040cbc44e2b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.179412 Aug 08 17:04:01.972623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 236/459] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:02.083329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:02.084094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:02.090503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:02.091913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:02.093652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:02.094692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:02.095562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:02.096239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:02.247548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:02.256890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:02.264747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:02.264747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f6894cf-8547-45fa-926d-389630f3e2c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.183313 Aug 08 17:04:02.264747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 224/460] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:02.985230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:02.985863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:02.991719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:02.996766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:02.996766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:03.002267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.002764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.002952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.003202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.003918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.004064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.004659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.004781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.005188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.006160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.007197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.007984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.085662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:03.095278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-55f6e479-aa6f-47ca-8729-5df816663781 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.113917 Aug 08 17:04:03.096040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 237/461] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:03.165521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:03.174428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27d48c2d-a5a1-437c-86aa-d215cdafd0c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.183865 Aug 08 17:04:03.175011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 225/462] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:03.282818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:03.283365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:03.291010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.291525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.291966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.292749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:03.293218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:03.293744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:03.438180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:03.446578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:03.448231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:03.449380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-902b388d-ad72-4ec2-adc2-deacae7f4258 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.170638 Aug 08 17:04:03.449951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 238/463] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:04.116740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:04.117392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:04.124573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.125076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.125517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.126279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.126740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.127164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.191708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:04.197681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:04.199297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:04.201175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4bd1c7dc-d11c-47fc-addc-35e362c30b12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.088092 Aug 08 17:04:04.204218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 226/464] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:04.209624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.210573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.211266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.212278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.212991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.213750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.362583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:04.370308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-edb69cbd-4a9c-4553-8699-31e1c3028c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.176568 Aug 08 17:04:04.370778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 239/465] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:04.472479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:04.473118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:04.479332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.480168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.480618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.481323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:04.481781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:04.482235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:04.624085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:04.632507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:04.634079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:04.635238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8f71e9ac-b407-4d5d-9be4-83ac3a9ee533 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.166862 Aug 08 17:04:04.635796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 227/466] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:05.229095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:05.230109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:05.239520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.240036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.241943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.241943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.241943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.242211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.309065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:05.329199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7e3b551d-1e5c-48b7-ab10-e1f9a4d5e88f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.104445 Aug 08 17:04:05.329778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 240/467] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:05.391643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:05.392273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:05.394848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:05.399866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.400355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.400798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.401509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.402214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.402651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.539097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:05.546993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a26d7005-e817-4b3f-81b4-9616e9604a16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.159494 Aug 08 17:04:05.547548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 228/468] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:05.659359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:05.659962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:05.666184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.666662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.667096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.667778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:05.668227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:05.668645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:05.807749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:05.817074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:05.818661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:05.819830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39746ca2-525f-4fd2-841c-8740edd9b9aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.164586 Aug 08 17:04:05.833077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 241/469] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:06.349752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:06.350403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:06.357297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.357993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.359008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.359375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.359835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.360268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.439038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:06.446756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54b9be1f-5ff3-4ae2-988d-687f9c89a58a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.100917 Aug 08 17:04:06.447339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 229/470] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:06.568038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:06.568785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:06.571602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:06.576723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.577226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.577668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.578410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.578873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.579300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.713902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:06.722291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1b6d57f0-2170-493c-9b78-3d8a15ea2e29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.158390 Aug 08 17:04:06.722860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 242/471] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:06.845313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:06.846066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:06.852048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.852582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.853011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.853689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:06.854171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:06.854588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:06.990080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:06.998674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:07.002463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:07.002463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e4ac705-2a5d-42cd-b100-2fc57ee61184 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.160955 Aug 08 17:04:07.002463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 230/472] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:07.468108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:07.468817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:07.475762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:07.476256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:07.476696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:07.477398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:07.477877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:07.478301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:07.543625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:07.554111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-237e15ca-bd00-43f9-8bfa-53cdb900009d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1139 microversion: 2.1 time: 0.089768 Aug 08 17:04:07.554899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 243/473] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:07.744095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:07.744697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:07.747071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:07.753425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:07.754016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:07.754484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:07.758995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:07.758995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:07.758995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:07.896682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:07.905220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-366c07da-cde2-4500-8f63-0fccadd80b42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.164971 Aug 08 17:04:07.905873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 231/474] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:08.025249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:08.026029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:08.033065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.038442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.038442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:08.038442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.038442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.038846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:08.194580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:08.203416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:08.207911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:08.209461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-05744185-3c46-4c25-be7b-2259e1b51444 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.188135 Aug 08 17:04:08.210392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 244/475] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:08.575528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:08.576659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:08.582795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.583480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.583876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:08.584576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.585031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.585456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:08.647297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:08.650711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:08.655027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03963d8e-dd51-420d-91ab-6b961b3d86fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1131 microversion: 2.1 time: 0.083771 Aug 08 17:04:08.655584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 232/476] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1131 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:08.927264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:08.927788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:08.934938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.935406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.935842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:08.936584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:08.937091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:08.937516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:09.067213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:09.078554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7432a5aa-3d1a-4b2f-9ad1-00703b7a7ac7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.154978 Aug 08 17:04:09.079471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 245/477] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:09.234854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:09.235744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:09.245526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:09.246244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:09.246851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:09.247843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:09.248487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:09.249082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:09.395294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:09.404162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:09.405253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:09.407064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b2eac9ee-822a-4b23-9838-2b16f579f66c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.178192 Aug 08 17:04:09.407636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 233/478] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:09.675991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:09.676613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:09.682778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:09.683268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:09.683708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:09.687653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:09.687653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:09.687653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:09.960568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:09.968104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ffcbc06c-27ba-41bc-a479-336031cf2fd9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1187 microversion: 2.1 time: 0.296298 Aug 08 17:04:09.968666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 246/479] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1187 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:10.100573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:10.101181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:10.107206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.107737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.108672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:10.109403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.109895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.110323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:10.244973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:10.253300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a38dd9f4-4458-494b-8a8b-51ceb73f46b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.156734 Aug 08 17:04:10.253899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 234/480] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:10.430432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:10.431052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:10.437440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.438029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.438400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:10.439173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.439624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.440048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:10.572705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:10.581822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:10.583355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:10.584587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-85831d8b-854a-439c-8da6-3bb828297c62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.158040 Aug 08 17:04:10.587707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 247/481] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:10.988942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:10.989555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:10.995517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.996000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.996436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:10.997124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:10.997574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:10.998252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:11.058711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:11.066852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b649d244-df5a-4080-976c-678962e4c927 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1187 microversion: 2.1 time: 0.081927 Aug 08 17:04:11.067423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 235/482] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:11.273129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:11.273679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:11.279852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:11.280345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:11.280782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:11.281467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:11.281948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:11.282374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:11.408960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:11.416722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d22368b8-4ba7-446b-bd16-cfb06b6f1fe7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1372 microversion: 2.1 time: 0.147568 Aug 08 17:04:11.417272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 248/483] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:11.609149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:11.609844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:11.616301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:11.620599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:11.620599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:11.620599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:11.620599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:11.620988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:11.752245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:11.760625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:11.762246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:11.763449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b7953e4-f738-49de-a0b3-89cd71d053f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.158813 Aug 08 17:04:11.764009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 236/484] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:12.088675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:12.089269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:12.096475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.096955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.097393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.098113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.098567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.098989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.165542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:12.173305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7c01e670-6352-4ae5-b4a1-13d114914f33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1187 microversion: 2.1 time: 0.088448 Aug 08 17:04:12.173898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 249/485] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:12.438398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:12.439209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:12.447515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.447515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.447515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.453013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.453013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.453013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.593659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:12.601542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6e93df5-7210-46b8-9756-558322385733 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1567 microversion: 2.1 time: 0.167303 Aug 08 17:04:12.602151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 237/486] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:12.622995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:12.622995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:12.629847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.630335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.630772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.631466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.631921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.632343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.636259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:12.727680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb51a66d-f7c4-4902-876f-36db1bea551c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109233 Aug 08 17:04:12.728304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 250/487] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:04:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:12.785899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:12.786511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:12.793764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.794436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.794880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.795690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:12.796145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:12.796738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:12.955061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:12.964726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:12.966301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:12.967528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2e079f9-0484-46bb-8429-52a950ffced0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.185502 Aug 08 17:04:12.968103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 238/488] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:13.195543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:13.196788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:13.208387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:13.209422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:13.210101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:13.211106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:13.211726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:13.212322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:13.445883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:13.462466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c30de325-cd68-41da-94ac-5b5f271f9f37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1195 microversion: 2.1 time: 0.272129 Aug 08 17:04:13.463520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 251/489] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1195 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:13.992028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:13.996608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:14.001265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.001756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.002225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.002929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.003381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.003933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.207665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:14.217233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:14.218881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:14.220098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb7a9887-8e8d-4ad2-a14e-153ec819f3a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.231982 Aug 08 17:04:14.220673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 239/490] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:14.485637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:14.486885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:14.510871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:14.526700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.527573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.528023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.528746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.529239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.529669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.532048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.532497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.533124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.558294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] Creating event network-changed:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:04:14.564587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-069fa9c1-46ef-4c74-8459-a7e4aff287b8 req-f57b3156-0add-41a1-a53a-375f15b29ef1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057469 Aug 08 17:04:14.565186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 240/491] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:04:14.678787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:14.687069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b26e2400-09fb-401c-8013-eb2657e32b28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.206532 Aug 08 17:04:14.687651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 252/492] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:15.185214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:15.185822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:15.192530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.193102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.193626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.195211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.195776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.196339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.227747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f0fa8bd1-c9a4-4858-8fa2-0c1d9ab059f4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/ips" status: 200 len: 149 microversion: 2.1 time: 0.047306 Aug 08 17:04:15.228322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 241/493] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:04:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:15.249304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:15.250118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:15.257247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.258238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.258727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.259637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.260317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.260937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.434796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:15.444756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:15.446688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:15.448736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cbebe7c8-5788-48a4-9d8f-985f5e7c58e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.205632 Aug 08 17:04:15.449304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 253/494] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:15.708789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:15.709414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:15.715666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.716156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.716594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.717324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:15.719391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:15.719391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:15.860553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:15.868625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-62e73283-f97d-4622-a4ef-9439f042a772 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.163833 Aug 08 17:04:15.869202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 242/495] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:16.476053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:16.476653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:16.483065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:16.483539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:16.483970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:16.484662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:16.485113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:16.485534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:16.621112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:16.630131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:16.631657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:16.632862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9d4e63aa-daf5-46df-b022-cf03dc3aff43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.160640 Aug 08 17:04:16.633360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 254/496] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:16.891477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:16.891996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:16.898286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:16.898772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:16.899206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:16.899909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:16.900363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:16.900792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:17.047829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:17.055460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a1239ed8-b021-45b7-903d-40a797a8fb07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.168148 Aug 08 17:04:17.056025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 243/497] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:17.657101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:17.657715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:17.664180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:17.669187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:17.669187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:17.669187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:17.669187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:17.669552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:17.812802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:17.821412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:17.822946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:17.824167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7aa282f4-f74e-47a6-87c9-84c56bf39a8e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.171964 Aug 08 17:04:17.824720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 255/498] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:18.076287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:18.078633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:18.080960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:18.086337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.087142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.087278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.088077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.088537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.089183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.320448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aa76cac-2774-4f95-8f69-b8c5e5ec241d"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:18.323179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:18.334754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.335260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.335712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.336535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.336908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.337357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.601061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:18.609200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8c4830e-736e-480f-b0e5-bd9a7126218f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.536685 Aug 08 17:04:18.609917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 244/499] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:18.848452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:18.849016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:18.855233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.855707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.856142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.856838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.857440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.858013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.074666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:19.090662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:19.092357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:19.105992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-836dd0bf-aff4-4e49-8c33-3ea1bb756a34 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.261846 Aug 08 17:04:19.106578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 245/500] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:04:19.188753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:19.200509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:19.201086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:19.201413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.213347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] Creating event network-changed:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:04:19.219041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-2eee3ecc-1596-4061-9e3f-94685665b765 req-6397ccea-063d-4df2-b0a8-c22b1f4aa72e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035651 Aug 08 17:04:19.219627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 246/501] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:04:19.604166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "name": "network-vif-plugged", "status": "completed", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:19.621263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:19.621263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:19.621712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.632897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] Creating event network-vif-plugged:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:04:19.639187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-924df051-9c97-4606-b351-653cd03edd15 req-b20f399a-61d2-4f71-bcbd-4a062c06998c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041278 Aug 08 17:04:19.641039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 247/502] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:04:19.646192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:19.646936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:19.654735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7432977f-76ef-4cbf-9ea8-9626db3b0660 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.337824 Aug 08 17:04:19.655937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:19.656519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:19.656828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.662182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 256/503] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:04:18 2022] POST /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:04:19.662509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:19.662509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:19.662509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.817083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:19.824864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8ecdc72-c79e-48fb-8d55-f03b3ed40808 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.182647 Aug 08 17:04:19.825752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 248/504] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:20.130841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:20.131493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:20.137832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.138329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.138770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.140110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.140574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.141007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.279409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:20.288025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:20.289538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:20.290990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-def5c969-76eb-4a69-815f-e3fa66080576 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.165092 Aug 08 17:04:20.291546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 257/505] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:04:20.847745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:20.848505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:20.856251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.856939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.857460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.858495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.859560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.860056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.996688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:21.004639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c80152de-b595-4fc1-932c-5bd611f4c6d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.162376 Aug 08 17:04:21.005208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 249/506] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:21.315225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:21.315834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:21.322401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:21.322885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:21.323315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:21.324010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:21.324461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:21.324883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:21.456443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:21.464888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:21.466466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:21.469945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8615162-6fe6-4f41-be57-854502fe7105 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.156462 Aug 08 17:04:21.470576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 258/507] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:04:22.024536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:22.026117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:22.031635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.032119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.032553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.033254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.033704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.034302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.184628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:22.194009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-72f6f0ea-243b-4efd-8406-7c2c2aab57b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.173189 Aug 08 17:04:22.194605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 250/508] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:22.492977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:22.493615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:22.500102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.500591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.501027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.501723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.502208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.502647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.641961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:22.654056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:22.656169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:22.658481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1870c5fe-744d-4df8-b64f-55c98d687931 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.168368 Aug 08 17:04:22.663070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 259/509] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:23.214204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:23.214753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:23.221676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.222881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.222881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.223512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.223965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.224383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.355571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:23.359781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:23.364076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a3b6a456-5b2f-4be0-9b8d-91dd9bb80226 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1273 microversion: 2.1 time: 0.153803 Aug 08 17:04:23.364639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 251/510] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:23.680713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:23.682091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:23.690402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.691145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.692131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.692923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.693454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.693991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.843479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:23.851943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:23.859591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:23.859591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9961dae1-b4e7-464b-b4c7-f09ea77ae1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.178476 Aug 08 17:04:23.859591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 260/511] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:24.385265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:24.386391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:24.393725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.394239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.394671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:24.395355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.395808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.396231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:24.529354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:24.537486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7931b097-0c5f-4304-b661-df18a1cca79a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.156233 Aug 08 17:04:24.538083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 252/512] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:24.877887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:24.878522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:24.884827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.885309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.885846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:24.886544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.887003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.887432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:25.028538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:25.038074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:25.040869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:25.041086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cadc3673-ac7f-4841-ae1d-06cb00c247f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.167739 Aug 08 17:04:25.041650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 261/513] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:25.559031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:25.559589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:25.566049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:25.566526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:25.566981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:25.567644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:25.568095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:25.568516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:25.700325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:25.708463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-20e57941-9b5c-4787-9c0d-7ed877be95a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.153365 Aug 08 17:04:25.709031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 253/514] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:26.064218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:26.064816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:26.071761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.072259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.072676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.073374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.073931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.079390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.204912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:26.213447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:26.214997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:26.216462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7fc42a3-0e11-473a-a942-75eff5000883 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.156447 Aug 08 17:04:26.217035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 262/515] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:26.732863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:26.733534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:26.740771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.741265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.741697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.742455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.742908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.743331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.885720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:26.899014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0fb48ef-eba4-4fca-933c-0ef7dde00e5c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.170069 Aug 08 17:04:26.899584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 254/516] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:27.254400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:27.255014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:27.261644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.262087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.262523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:27.263214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.263667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.264089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:27.402756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:27.411900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:27.413396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:27.414572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6e693d6a-32c9-40a3-95aa-4001bf48f1cd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.164051 Aug 08 17:04:27.415410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 263/517] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:27.919368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:27.919929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:27.926425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.926910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.927343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:27.928030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.928483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.928903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:28.062223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:28.069916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-91654266-dd0f-4126-8618-4cbdc2cccad5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.154683 Aug 08 17:04:28.072936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 255/518] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:28.437931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:28.438563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:28.444904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:28.445387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:28.445849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:28.446543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:28.447001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:28.447428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:28.580497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:28.593712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:28.595440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:28.596637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2797a543-4ac7-494f-a6a4-640ef57128d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.163092 Aug 08 17:04:28.597221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 264/519] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:29.091144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:29.091750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:29.098792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.099295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.099730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.100438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.100895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.101339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.238165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:29.245658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c05f352a-0c91-4b12-8197-748c8161c43d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.158370 Aug 08 17:04:29.246260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 256/520] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:29.618881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:29.619436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:29.626039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.626522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.626960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.627655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.628109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.628533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.762084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:29.766142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:29.771583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:29.773132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:29.774338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-24d3fca8-05bb-4653-90bb-ddce132652a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.159463 Aug 08 17:04:29.774888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 265/521] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:30.265579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:30.266226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:30.272800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.273284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.273719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.274455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.274912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.275335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.423585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:30.431307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2b9d03e3-3aa4-495c-a1c7-d8950f1e68f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.169549 Aug 08 17:04:30.431879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 257/522] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:30.799124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:30.799658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:30.807148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.807640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.808081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.808784 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.809242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.809675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.944288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:30.953216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:30.954737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:30.955892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-23448e42-2e80-44b5-833f-111016c6681f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1807 microversion: 2.20 time: 0.161796 Aug 08 17:04:30.956453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 266/523] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:31.457726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:31.458883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:31.470772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.471634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.472086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:31.472806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.473266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.473693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:31.621983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:31.630530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c425af1-0d94-4949-a48e-1fecc1075455 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.180761 Aug 08 17:04:31.631105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 258/524] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:31.979947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:31.980561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:31.988210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.988696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.989132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:31.989870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.990333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.990758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:32.127236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:32.136125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:32.137686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:32.138895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c2fa54a7-9a71-46b6-8122-73b66b5052fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1794 microversion: 2.20 time: 0.163037 Aug 08 17:04:32.139453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 267/525] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:04:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:04:32.651974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:32.652592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:32.659940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:32.660425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:32.660889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:32.661584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:32.662058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:32.662480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:32.821301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:32.829601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e63e7148-c95d-4060-8242-86591b89f015 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.181537 Aug 08 17:04:32.830199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 259/526] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:33.850739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:33.851293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:33.853740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=62 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:33.859171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.859658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.860100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.860800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.861247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.861672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.917860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:33.918431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:33.925301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.925592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.926107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.926756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.927212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.927685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:34.017423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:34.025243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7d468f97-6887-46be-8b71-22457182ef28 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.178384 Aug 08 17:04:34.025827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 268/527] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:34.081668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid d590a811-973f-4e31-8808-7471e74086a7 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:04:34.363931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68a6281d-73cc-4ed9-a694-75038b826717 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7/os-volume_attachments/ef93b5b8-abd6-4ddf-b826-e0636af05b96" status: 202 len: 0 microversion: 2.1 time: 0.449786 Aug 08 17:04:34.364549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 260/528] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:04:33 2022] DELETE /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7/os-volume_attachments/ef93b5b8-abd6-4ddf-b826-e0636af05b96 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:04:35.047652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:35.048191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:35.054547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:35.055034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:35.055503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:35.056193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:35.056644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:35.057115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:35.196046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:35.203677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0b3d7902-72e3-4c4f-8229-635a93635057 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.160660 Aug 08 17:04:35.204247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 269/529] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:36.226671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:36.227358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:36.234208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:36.234704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:36.235144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:36.235847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:36.236303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:36.236729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:36.374606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:36.382305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1bdd77e4-0e68-4860-bc63-89d7b22b6ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.160328 Aug 08 17:04:36.382891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 261/530] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:37.402966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:37.403581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:37.410785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:37.411299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:37.411733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:37.412431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:37.412903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:37.413325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:37.550595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:37.558518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-04871f51-62af-4582-8eaf-7a2bd4061cd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.159478 Aug 08 17:04:37.559368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 270/531] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:38.582406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:38.583478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:38.590906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:38.591341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:38.592149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:38.593832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:38.594526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:38.595375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:38.750580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:38.758048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-02767efa-7d0f-47d7-b976-05779af8d7f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.182352 Aug 08 17:04:38.758618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 262/532] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:39.119069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd37a1bf-4893-4c45-aed0-57a5484c2e15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: .version_select at 0x7f7438989040>, body: {"keypair": {"name": "tempest-keypair-694917514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPJgyOFWrjA/AQrJS/KdkfU9/73nYQmNnfulk560XPJ8bAf1T/l4yhZz8cXIQg3y8X5KRpeEVdDizAh6QDlwfnUnGmbX8sX86plMWzO7IfzcWMKmv7cRHM4jTcsh2NtTg=="}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:39.135302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-fd37a1bf-4893-4c45-aed0-57a5484c2e15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:04:39.139963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-fd37a1bf-4893-4c45-aed0-57a5484c2e15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:04:39.234011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd37a1bf-4893-4c45-aed0-57a5484c2e15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118737 Aug 08 17:04:39.234619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 271/533] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:04:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:39.731647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:39.732187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:39.739217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:39.739696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:39.740136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:39.740823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:39.741279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:39.741703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:39.767326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:04:39.780572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:39.781411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:39.787710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:39.788412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:39.789299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:39.790454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:39.791060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:39.791623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:39.961424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:39.980648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d530e3aa-d8b9-4752-bb2d-7748f80dddde tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.204947 Aug 08 17:04:39.982498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 272/534] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:40.061090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb973b50-d4bb-4069-899e-fcca7ee9fbb0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 204 len: 0 microversion: 2.1 time: 0.332842 Aug 08 17:04:40.061816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 263/535] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:04:39 2022] DELETE /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:04:40.072561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:40.073353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:40.079925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:40.080434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:40.080873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:40.081568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:40.082070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:40.082489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:40.223107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "name": "network-vif-plugged", "status": "completed", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:40.235185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:40.235787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:40.236307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:40.252519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] Creating event network-vif-plugged:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:04:40.261120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-5e6c1eda-84f2-4cc1-8799-9ebc50616370 req-f2cc1a77-3649-4c73-b8cc-0eb9805ed345 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037462 Aug 08 17:04:40.261120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 264/536] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:04:40.265875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:40.275567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a1c15db9-ed81-4c41-9701-3f6ae7c5d49c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1512 microversion: 2.1 time: 0.207043 Aug 08 17:04:40.276158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 273/537] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:40 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:41.003877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:41.004571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:41.010917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:41.011408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:41.011844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:41.012538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:41.012991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:41.013412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:41.256633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:41.264229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-91d8bcf3-31ba-421f-8296-f8dea41f2f82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.265534 Aug 08 17:04:41.264667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 265/538] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:41.299491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:41.300146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:41.306744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:41.307234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:41.307671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:41.308359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:41.308870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:41.309296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:41.448314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:41.457071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-27bdeec4-8f97-4a53-bcf2-9e014f8e0f61 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1512 microversion: 2.1 time: 0.162021 Aug 08 17:04:41.457658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 274/539] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:41 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:41.838955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1083458059", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36f0450b-5607-4e0f-8828-7eaf46e83a10"}], "security_groups": [{"name": "tempest-securitygroup--1412800271"}], "key_name": "tempest-keypair-694917514", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:41.947219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] validate_networks() for [('36f0450b-5607-4e0f-8828-7eaf46e83a10', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:04:42.284974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:42.286010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:42.291988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.292472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.292941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.293643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.294127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.294554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.331971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:04:42.337187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:04:42.337187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:04:42.337187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:04:42.337187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:04:42.342802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.343358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.343780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.344492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.344936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.345353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.362851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:04:42.366846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:04:42.378791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:04:42.381045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:04:42.442205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:42.449748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4da9e480-d913-4723-b5c3-ade0fdb1404c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.168763 Aug 08 17:04:42.454397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 275/540] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:42.478522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:42.479135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:42.485722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.486188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.486632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.487330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:42.487789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:42.488217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:42.519134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e784628-7057-4382-b861-173460e3051f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684485 Aug 08 17:04:42.519918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 266/541] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:04:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:04:42.531482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ba57973-8e54-4c4f-863d-14eb9ac87dec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:42.532093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ba57973-8e54-4c4f-863d-14eb9ac87dec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:42.601838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ba57973-8e54-4c4f-863d-14eb9ac87dec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:42.610172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ba57973-8e54-4c4f-863d-14eb9ac87dec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1241 microversion: 2.1 time: 0.082956 Aug 08 17:04:42.610752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 267/542] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:42 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:42.661648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:42.671775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e59bdcf9-c356-44a9-bf4b-4b9225113574 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1512 microversion: 2.1 time: 0.197108 Aug 08 17:04:42.672359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 276/543] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:42 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:43.470644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:43.471332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:43.478229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.478720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.479166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.479866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.480319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.480752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.499782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:43.616101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:43.624177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-679c241d-0bf9-4af7-846c-54cb9de1f726 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.156947 Aug 08 17:04:43.624755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 268/544] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:43.630934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:43.631552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:43.637971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.638458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.638967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.640142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.640604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.641029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.695283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:43.696365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:43.702124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:43.707382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.707974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.708745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.710009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:43.710167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-47559358-a45b-449b-b5d2-178dcca455ab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1245 microversion: 2.1 time: 0.082998 Aug 08 17:04:43.710770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 277/545] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:43 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:43.711055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:43.711435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:43.852967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:43.861247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a81cf34-9a78-417a-824b-a5359f5d67a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1512 microversion: 2.1 time: 0.171465 Aug 08 17:04:43.861843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 269/546] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:43 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:44.645298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:44.646097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:44.652439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.652926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.653364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:44.654151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.655252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.655859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:44.730968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:44.732655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:44.740420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.740910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.741344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:44.742063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.742516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.742934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:44.799884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:44.808281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8bc3f2a-be96-4624-8539-11eae5907f57 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1261 microversion: 2.1 time: 0.166855 Aug 08 17:04:44.809044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 278/547] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:44.842355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:44.850269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c036073c-f5f2-4f9d-9f75-d19c65c1a7fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1245 microversion: 2.1 time: 0.123079 Aug 08 17:04:44.850872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 270/548] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:44 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:44.883192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:44.883192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:44.890455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.890941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.891383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:44.892150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:44.892627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:44.893413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.044994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:45.053133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-327df2e0-a2da-4180-8a3b-6634315a1c6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1512 microversion: 2.1 time: 0.174415 Aug 08 17:04:45.053748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 279/549] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:44 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:45.225506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d590a811-973f-4e31-8808-7471e74086a7", "name": "network-vif-deleted", "tag": "39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:45.240085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:45.240566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:45.240985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.252822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] Creating event network-vif-deleted:39f15b5e-2a5e-4449-a0e3-90d5cb7d0cf9 for instance d590a811-973f-4e31-8808-7471e74086a7 on hv-cinder-85221 Aug 08 17:04:45.257681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-248ab1dd-6673-4be2-aedf-e97710e12fee req-64af46fc-56bd-4141-a3ec-b7161b40f3f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038104 Aug 08 17:04:45.258307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 271/550] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:45.829673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:45.830316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:45.836750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:45.837233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:45.837667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.838467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:45.838978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:45.839346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.872142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:45.872843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:45.879310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:45.879798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:45.880235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.880937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:45.881391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:45.881859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:45.949483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:45.957659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-101ac70a-6910-4189-82bc-67d8e6a78e00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1293 microversion: 2.1 time: 0.090063 Aug 08 17:04:45.958267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 272/551] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:45 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:45.979843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:45.987749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-de0872f7-f704-4ee8-b5bb-6c8ed0ec4c07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1445 microversion: 2.1 time: 0.161891 Aug 08 17:04:45.988320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 280/552] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:46.008996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:46.009600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:46.016622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.017254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.017697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:46.018432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.019201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.019625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:46.075076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:46.075749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:46.082957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.083452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.083886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:46.084637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.085092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.085512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:46.148777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:46.157596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f026b9eb-1e4c-4b47-86b0-3c5f238bdefb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1470 microversion: 2.1 time: 0.086312 Aug 08 17:04:46.158402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 281/553] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:46 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1470 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:46.165541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:46.173641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-26625636-5942-4af7-8ca9-ea2419394125 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1445 microversion: 2.1 time: 0.168452 Aug 08 17:04:46.174249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 273/554] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:46.979202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:46.979832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:46.988392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.988815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.989924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:46.990653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:46.991110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:46.991542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:47.085325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:47.094726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-957d7ff3-0c3a-435b-98f0-443e838dc465 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1293 microversion: 2.1 time: 0.119338 Aug 08 17:04:47.095319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 282/555] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:46 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:47.184218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:47.186503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:47.197837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:47.204177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:47.204177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:47.204177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:47.204177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:47.204567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:47.233664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:47.234182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:47.234616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:47.235079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'fault' on Instance uuid d590a811-973f-4e31-8808-7471e74086a7 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:04:47.276442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:47.285316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3115ea1b-8dd8-42bc-87a9-1b61ac2e8d14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 200 len: 1308 microversion: 2.1 time: 0.109508 Aug 08 17:04:47.285949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 274/556] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:47 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:48.116522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:48.117142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:48.125160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:48.125651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:48.126120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:48.126891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:48.127342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:48.127766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:48.147662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:48.229385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:48.237619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fbf89373-fd06-4573-98be-80cd8dab6cb4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1299 microversion: 2.1 time: 0.124945 Aug 08 17:04:48.238258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 283/557] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:48 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:48.308146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:48.308881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: d590a811-973f-4e31-8808-7471e74086a7] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:48.313149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:48.316700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:48.326597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:48.326597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:48.326597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:48.326597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:48.327086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:48.333312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] HTTP exception thrown: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Request method failure captured: Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 HTTP/1.1 Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGVyIjUpM7AoMQrcMyhTR7AY55hoAc3uSnbjnK6HMP9yD_o4zrSyFrhAUMQMO2EsZsss7Lg451l_V4UoUejd572weHrx2BgSI1GfYG6zwFSYpx-_HBVJmHD1X6rsP9aRdArQpXtuPLk5--kx6o9qmrEsvZsjyFUaGJmNfF-CD3SjpE Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:04:48.335154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63b568870ecc4e4797919608bd9273ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: e941c29e3df944a08f18f5e029a28977 Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. Aug 08 17:04:48.336735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'd590a811-973f-4e31-8808-7471e74086a7'} Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:04:48.337651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. Aug 08 17:04:48.339303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:04:48.341324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Returning 404 to user: Instance d590a811-973f-4e31-8808-7471e74086a7 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:04:48.342246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1249920f-1163-40e1-8ac9-48f7decf6f25 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7" status: 404 len: 111 microversion: 2.1 time: 0.038165 Aug 08 17:04:48.343166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 275/558] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:48 2022] GET /compute/v2.1/servers/d590a811-973f-4e31-8808-7471e74086a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:04:48.517348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:48.527913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:48.528394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:48.528828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:48.541337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] Creating event network-changed:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:04:48.546992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-127ab1ca-97e0-40a2-b24b-e91493578c73 req-6f6fae8b-bd04-4583-bc59-bb10e71195ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033915 Aug 08 17:04:48.548764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 284/559] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:49.259363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:49.260063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:49.267912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:49.268895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:49.269495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:49.270646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:49.271279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:49.271709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:49.481980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:49.490346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f310f6b4-6786-436a-b086-93f6c63aff2f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.234638 Aug 08 17:04:49.491512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 276/560] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:49 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:49.819775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:49.831227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637a5c03-c639-4da1-8b40-5f1ac17b21ab", "tag": "e07f5704-fa0e-4d29-a752-85d47d463662"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:49.833511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:49.834074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:49.834511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:49.845221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] Creating event network-changed:e07f5704-fa0e-4d29-a752-85d47d463662 for instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab on hv-cinder-85221 Aug 08 17:04:49.850166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-bce1be8e-738f-4120-b9e0-071d934b96ad req-b62bea2a-9743-4fa3-95e4-1cad84cd6d2d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031527 Aug 08 17:04:49.850955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 285/561] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:50.513198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:50.514535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:50.522099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:50.522603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:50.523038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:50.523764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:50.524224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:50.524659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:50.685069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:50.693355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3b63f695-125b-4176-88b5-9eedea974c40 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.184358 Aug 08 17:04:50.693963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 277/562] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:50 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:04:51.716368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:51.717610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:51.724017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:51.724509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:51.724951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:51.725677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:51.726193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:51.726674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:51.855403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:51.863452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-84893094-c95f-406c-86cd-54c062534eb8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.152294 Aug 08 17:04:51.864012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 286/563] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:51 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:52.885686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:52.886307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:52.888556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:52.889311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:52.894067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:52.894608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:52.894980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:52.895665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:52.896118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:52.896541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:53.031958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:53.039963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2b78069b-4b40-4ae9-a1a8-f50e474c3d6e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.157981 Aug 08 17:04:53.044836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 278/564] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:52 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:54.060920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:54.061603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:54.068680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:54.069195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:54.069629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:54.070386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:54.070844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:54.071267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:54.238881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:54.246369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39d7ec5d-bae5-4244-b0b7-5e43f095e299 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.189479 Aug 08 17:04:54.246933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 287/565] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:54 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:55.268702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:55.269348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:55.276092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:55.276580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:55.277013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:55.277716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:55.278375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:55.278941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:55.420199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:55.427947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4fd592e-c78c-48e9-be55-3ee924c7b03c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.163735 Aug 08 17:04:55.428522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 279/566] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:55 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:56.449759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:56.450388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:56.457454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:56.457977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:56.458419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:56.459121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:56.459576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:56.460010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:56.595292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:56.603012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b5c7a11-bcf0-43fe-81fd-38dc2ba330cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.157058 Aug 08 17:04:56.603585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 288/567] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:56 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:57.624517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:57.625166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:57.632233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:57.632710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:57.633142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:57.633860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:57.634312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:57.634729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:57.769723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:57.777301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4581be1c-b577-4c38-a215-03adb7d3fb44 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.156635 Aug 08 17:04:57.777884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 280/568] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:57 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:58.799256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:58.799932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:58.807297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:58.807839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:58.808227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:58.808933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:58.809388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:58.809869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:58.946509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:58.954914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cfff995e-36e6-45aa-ab7e-e818903e3879 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.159589 Aug 08 17:04:58.955487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 289/569] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:58 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:59.976092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:59.976768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:59.986755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:59.987880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:59.988383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:59.989526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:59.990325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:59.991049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:00.147424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-571134327", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "networks": [{"uuid": "170b95b4-5f54-4678-af52-d1d85111a68e"}]}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:00.153641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:00.158724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1551f0dc-3e5d-4686-87eb-a7993d6b8153 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.186530 Aug 08 17:05:00.159326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 281/570] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:59 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:00.202071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.network.neutron [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] validate_networks() for [('170b95b4-5f54-4678-af52-d1d85111a68e', None, None, None, None, None)] {{(pid=130500) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:05:00.568064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Flavor limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:05:00.568491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Image limits 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:05:00.568971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Flavor pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:05:00.569570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Image pref 0:0:0 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:05:00.571388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.virt.hardware [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:05:00.581295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:00.581869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:00.582353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:00.583221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:00.583730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:00.584414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:00.603525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Getting quotas for project 63b568870ecc4e4797919608bd9273ad. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:05:00.608182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.quota [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Getting quotas for user e941c29e3df944a08f18f5e029a28977 and project 63b568870ecc4e4797919608bd9273ad. Resources: {'cores', 'ram', 'instances'} {{(pid=130500) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:05:00.620411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Going to run 1 instances... {{(pid=130500) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:05:00.622734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:05:00.739199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d5781251-f391-49ae-82e7-a7d40c3e8dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595567 Aug 08 17:05:00.741981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 290/571] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:05:00.751852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-06a29298-ecfd-4872-a47a-081a4be66f6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:00.752512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-06a29298-ecfd-4872-a47a-081a4be66f6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:00.805626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-06a29298-ecfd-4872-a47a-081a4be66f6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:00.815328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-06a29298-ecfd-4872-a47a-081a4be66f6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1218 microversion: 2.1 time: 0.066803 Aug 08 17:05:00.815945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 282/572] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:01.183343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:01.183975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:01.191135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:01.191641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:01.192116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:01.192901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:01.193408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:01.193934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:01.331296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:01.336541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b8f24e48-d334-4a90-9e9a-f9b0c5a2b7bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.158185 Aug 08 17:05:01.337335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 291/573] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:01 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:01.838630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:01.841017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:01.849640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:01.850158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:01.850595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:01.851297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:01.851751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:01.852169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:01.941710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:01.949372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-258117de-4593-447b-9a00-b2f123e2d3ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1222 microversion: 2.1 time: 0.116715 Aug 08 17:05:01.949996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 283/574] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:02.358033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:02.358650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:02.366987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:02.367486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:02.367930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:02.368637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:02.369101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:02.369533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:02.516961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:02.525829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d728b8e6-3512-4429-b771-9b1a6c1802f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.171734 Aug 08 17:05:02.526399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 292/575] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:02 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:02.902491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637a5c03-c639-4da1-8b40-5f1ac17b21ab", "name": "network-vif-plugged", "status": "completed", "tag": "e07f5704-fa0e-4d29-a752-85d47d463662"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:02.913250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:02.913949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:02.914180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:02.926136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] Creating event network-vif-plugged:e07f5704-fa0e-4d29-a752-85d47d463662 for instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab on hv-cinder-85221 Aug 08 17:05:02.931237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-2d23f3b6-d865-40be-a737-a2b9bb3cedc8 req-3b5f9d73-aaf9-4e28-ab97-66ce5bea6840 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Aug 08 17:05:02.931828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 284/576] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:02.970791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:02.971384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:02.977468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:02.977976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:02.978412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:02.979098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:02.979550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:02.980002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:03.044997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:03.053362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7819e1e-e686-49af-ab9b-c2578c267741 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1270 microversion: 2.1 time: 0.086918 Aug 08 17:05:03.054775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 293/577] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:02 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:03.557456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:03.558182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:03.564955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:03.565438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:03.565924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:03.566656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:03.567117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:03.567546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:03.704708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:03.712380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f2d6705-e511-4bc4-a9f7-f7fcc3f0d9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.159226 Aug 08 17:05:03.712960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 285/578] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:03 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:04.075027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:04.075689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:04.078176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:04.083371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:04.090519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:04.090519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:04.090519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:04.090519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:04.090929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:04.153704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:04.161877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5f899e5f-7d2b-4a64-b4a3-cfa324145c65 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1278 microversion: 2.1 time: 0.091072 Aug 08 17:05:04.162454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 294/579] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:04.733041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:04.733648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:04.740128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:04.740628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:04.741058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:04.741735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:04.742212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:04.742648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:04.961680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:04.970362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-472e6b73-05a5-421b-922c-9fc7f9543e5d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.240541 Aug 08 17:05:04.972988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 286/580] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:04 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:05.185485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:05.186313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:05.193538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:05.194351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:05.194804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:05.195772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:05.196238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:05.196666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:05.270080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:05.277660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56fdbc92-00fb-48d2-9d58-f74a164e288f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1276 microversion: 2.1 time: 0.097624 Aug 08 17:05:05.278261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 295/581] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:05:05.991770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:05.992441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:05.999534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:06.000025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:06.001012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:06.001749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:06.002264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:06.002692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:06.278585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:06.282497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:06.287097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-177d3af7-59d7-4405-a30a-824008371cac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.299997 Aug 08 17:05:06.287700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 287/582] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:05 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:06.302015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:06.302646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:06.309685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:06.310223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:06.310670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:06.311394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:06.311866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:06.312301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:06.576305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:06.585287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-afd21759-a947-49ee-8d7f-6e7175416d8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.286899 Aug 08 17:05:06.585287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 296/583] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:06.901670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9e3502-9913-4006-a9e2-a7c235f37e0d", "tag": "f414c0b8-73f2-4493-8c86-8dfa7a282e53"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:06.913142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:06.913624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:06.914076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:06.926257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] Creating event network-changed:f414c0b8-73f2-4493-8c86-8dfa7a282e53 for instance ce9e3502-9913-4006-a9e2-a7c235f37e0d on hv-cinder-85221 Aug 08 17:05:06.931828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-09130d9f-a792-4cd8-8d8a-62c5b3115051 req-4bb022b5-085c-4b43-9b9e-cada5c151d8d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033981 Aug 08 17:05:06.932492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 288/584] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:05:07.309620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:07.310262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:07.317407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:07.318965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:07.319467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:07.320215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:07.320693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:07.321129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:07.459651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:07.467415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-366ae28b-e9a7-403a-a62f-330978124ac1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1367 microversion: 2.1 time: 0.161691 Aug 08 17:05:07.467992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 297/585] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:07 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:07.612050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:07.612847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:07.620408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:07.620956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:07.621386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:07.622281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:07.622732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:07.623166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:07.833935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:07.841570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-057f4061-53ad-476c-b85e-80b53cc3a2f6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.234702 Aug 08 17:05:07.842361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 289/586] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:07 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:05:08.488802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:08.489426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:08.495693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.496110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.496576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:08.497289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.497873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.498202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:08.629290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:08.637502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07781f34-d715-44bd-9a31-85cb239c5bd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1556 microversion: 2.1 time: 0.152692 Aug 08 17:05:08.638435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 298/587] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:08 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:08.658095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:08.671866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:08.671866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.671866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.671866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:08.672796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.672796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.672796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:08.750118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ef3dc55-25ec-46a9-b674-bf8ba48369a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096508 Aug 08 17:05:08.750759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 290/588] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:05:08 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:08.863512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:08.864139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:08.870802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.871298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.871739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:08.872457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:08.872954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:08.873384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:09.012602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:09.020267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56d6efdd-4d01-4999-80f0-d6c5f91d5bcf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.161391 Aug 08 17:05:09.020838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 299/589] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:10.041317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:10.042596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:10.050381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:10.050381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:10.051124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:10.051222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:10.051646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:10.052154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:10.059557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637a5c03-c639-4da1-8b40-5f1ac17b21ab", "tag": "e07f5704-fa0e-4d29-a752-85d47d463662"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:10.071781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:10.072422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:10.072968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:10.085672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] Creating event network-changed:e07f5704-fa0e-4d29-a752-85d47d463662 for instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab on hv-cinder-85221 Aug 08 17:05:10.091221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-65ad2cd2-5ff7-4d36-8442-265b97b533a8 req-f8088108-f952-4a2d-a883-f5fd7094d411 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035292 Aug 08 17:05:10.092136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 300/590] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:10.192267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:10.200033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f2566e80-6348-47d8-b813-972b57e9423c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.163247 Aug 08 17:05:10.201513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 291/591] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:10 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:11.218183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:11.219116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=6 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:11.223558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:11.224268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:11.231046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:11.231729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:11.232153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:11.232856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:11.233387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:11.233905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:11.377831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:11.386432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6c457db4-5730-4818-ad9e-9d1a0be79da8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.169181 Aug 08 17:05:11.387062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 301/592] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:12.408315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:12.408965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:12.411036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:12.416801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:12.417300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:12.417750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:12.418497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:12.418963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:12.419417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:12.551971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:12.559491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-504ec8db-d07b-4562-baa4-471cb84ab4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.156073 Aug 08 17:05:12.560145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 292/593] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:13.581271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:13.582000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:13.588551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:13.589078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:13.589523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:13.590273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:13.590732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:13.591160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:13.724509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:13.727984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:13.733625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-247c3c12-99a8-4fbf-8859-ab172fef7d79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.156838 Aug 08 17:05:13.734382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 302/594] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:14.756300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:14.756916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:14.763724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:14.764235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:14.764792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:14.765642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:14.766241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:14.767390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:14.903819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:14.911176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-942f2a6e-66cc-4b2c-8c62-da685c696138 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.158944 Aug 08 17:05:14.911737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 293/595] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:15.389408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9e3502-9913-4006-a9e2-a7c235f37e0d", "name": "network-vif-plugged", "status": "completed", "tag": "f414c0b8-73f2-4493-8c86-8dfa7a282e53"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:15.400017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:15.400500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:15.400929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:15.414123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] Creating event network-vif-plugged:f414c0b8-73f2-4493-8c86-8dfa7a282e53 for instance ce9e3502-9913-4006-a9e2-a7c235f37e0d on hv-cinder-85221 Aug 08 17:05:15.419362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-986bf66e-678c-4f38-a5f4-b1ffb3bda658 req-49697e8f-44f3-48a2-aab6-27ce7bb09776 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Aug 08 17:05:15.419957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 303/596] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:15.932523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:15.933071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:15.939407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:15.940010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:15.940448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:15.941134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:15.941584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:15.942036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:16.074274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:16.083024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-78975e28-cc8d-4272-abcd-0200e110384c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.154392 Aug 08 17:05:16.083667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 294/597] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:17.105242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:17.106007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:17.113087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:17.113577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:17.114044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:17.114745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:17.115208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:17.115658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:17.247206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:17.254731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc2e411e-7316-4d5d-9920-0769d717936f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1318 microversion: 2.1 time: 0.154323 Aug 08 17:05:17.255288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 304/598] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:17 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:18.275473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:18.276067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:18.282018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:18.282498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:18.282927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:18.283607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:18.284056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:18.284475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:18.427576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:05:18.434907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64c6200a-298f-4efd-a131-f183c6bc57af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1507 microversion: 2.1 time: 0.163449 Aug 08 17:05:18.435464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 295/599] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:05:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:05:18.454832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5730ad8-3b80-4faa-a777-bc5496f918a8", "device": "/dev/sdb"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:18.457619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:18.464003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:18.464484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:18.464913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:18.466073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:18.466199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:18.466517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:19.801254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:05:19.801869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:05:19.855703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-06683428-706d-415b-9b97-29823b99b8a8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "POST /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.404485 Aug 08 17:05:19.856335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 305/600] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:05:18 2022] POST /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments => generated 194 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:22.886612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:05:22.889040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:22.890953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=44 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:22.896610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:22.897097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:22.897533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:22.898312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:22.898770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:22.899194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:23.689495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6ea904c-e3e5-49b9-b36f-4b27df9ced6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909246 Aug 08 17:05:23.690135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 296/601] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:05:22 2022] POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:05:34.007859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=23 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:34.008656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:34.124625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:34.125240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:34.131510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.131990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.132424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.133119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.133612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.134043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.167913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1c572a2b-1b5d-44c7-99d8-cbccc741dcae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments/b31be6f5-ccb0-460d-b0a9-7d1308c4344b" status: 200 len: 194 microversion: 2.20 time: 0.161478 Aug 08 17:05:34.168404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 306/602] 10.222.0.57 () {60 vars in 1454 bytes} [Mon Aug 8 17:05:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments/b31be6f5-ccb0-460d-b0a9-7d1308c4344b => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:34.234313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:34.235150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:05:34.240189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:34.240689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:34.247296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.247795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.248229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.249008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.249466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.249927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.338398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lazy-loading 'services' on Instance uuid 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:05:34.688406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c105e49f-8e93-4509-9275-d1a27f8e6e48 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments/b31be6f5-ccb0-460d-b0a9-7d1308c4344b" status: 202 len: 0 microversion: 2.20 time: 0.455568 Aug 08 17:05:34.688984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 297/603] 10.222.0.57 () {60 vars in 1457 bytes} [Mon Aug 8 17:05:34 2022] DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments/b31be6f5-ccb0-460d-b0a9-7d1308c4344b => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:05:34.697763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:34.700251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:34.706674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.707653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.708126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.708820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:34.709276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:34.709759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:34.739439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-97df953d-1eec-49e0-b7c6-6d2447a92a22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045972 Aug 08 17:05:34.739986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 307/604] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:35.753810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:35.756109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:35.762670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:35.763151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:35.763591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:35.764287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:35.764736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:35.765161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:35.794778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-16f718ee-f479-4d9e-b826-80588af85c2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046226 Aug 08 17:05:35.795325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 298/605] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:36.807266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:36.809414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:36.815942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:36.816425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:36.816858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:36.817542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:36.818097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:36.818521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:36.849948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ab5c1bd7-8d99-4a8f-acbb-bede92699f24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046619 Aug 08 17:05:36.850580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 308/606] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:37.861683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:37.863850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:37.870392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:37.870876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:37.871309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:37.872002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:37.872449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:37.872865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:37.903434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6069b8b8-dbca-4082-aaa1-a271e38f6685 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045616 Aug 08 17:05:37.904011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 299/607] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:38.916290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:38.918558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:38.925042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:38.925537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:38.926012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:38.926729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:38.927191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:38.927623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:38.958803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6bfe6402-3208-456e-aefa-3173979d4df5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046764 Aug 08 17:05:38.959372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 309/608] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:39.972421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:39.974577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:39.981655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:39.982161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:39.982597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:39.983285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:39.983732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:39.984152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:40.014413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f8c6e2f-1917-4ca8-92dd-572ae538f2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045763 Aug 08 17:05:40.014980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 300/609] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:41.026997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:41.029588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:41.036287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:41.036779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:41.037224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:41.037976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:41.038436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:41.038863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:41.069676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2f2ce77b-9f47-4b4d-afd9-b124ab4aa5b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046711 Aug 08 17:05:41.070439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 310/610] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:42.082663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:42.084834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:42.092052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:42.092576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:42.093021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:42.093708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:42.094198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:42.094630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:42.124039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f7520c8-2637-4133-b2aa-19f3ea99bb7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045412 Aug 08 17:05:42.124598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 301/611] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:05:43.137033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:43.138945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:43.145488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:43.146016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:43.146456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:43.147151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:43.147604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:43.148028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:43.179598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-321d356f-eee5-4e07-86af-1b26681f21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046871 Aug 08 17:05:43.180209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 311/612] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:44.192090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:44.194238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:44.200724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:44.201210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:44.201643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:44.202370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:44.204053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:44.204487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:44.236342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27959d51-8d41-4df0-8b3d-d119bf8792ec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048160 Aug 08 17:05:44.236888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 302/613] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:45.248517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:45.250959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:45.257401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:45.257917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:45.258363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:45.259047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:45.259989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:45.260413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:45.291482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f2042998-9c1b-4ab7-874e-77cd2416df36 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046843 Aug 08 17:05:45.292081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 312/614] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:05:46.303737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:46.305870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:46.312746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:46.313227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:46.313664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:46.314386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:46.314847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:46.315250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:46.345069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d7644fcd-3956-428d-b897-d22399c226fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045237 Aug 08 17:05:46.345626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 303/615] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:47.357738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:47.359917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:47.366530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:47.367026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:47.367472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:47.368185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:47.368694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:47.369132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:47.400397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bcf1f519-386a-4c58-9daf-82c8d5755e04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047120 Aug 08 17:05:47.400972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 313/616] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:48.412866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:48.415841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:48.424407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:48.426064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:48.426064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:48.426572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:48.427023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:48.427439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:48.460940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5e390c68-016e-4e34-89b0-aeb1b8d7073c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052010 Aug 08 17:05:48.461498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 304/617] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:49.473533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:49.475844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:49.482923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:49.483443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:49.483881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:49.484571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:49.485026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:49.485445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:49.516666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-49df226e-6b8c-4d5d-98fc-c99acc980ae7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047014 Aug 08 17:05:49.517299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 314/618] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:50.529536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:50.531740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:50.538563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:50.539053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:50.539742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:50.540475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:50.540935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:50.541367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:50.575845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8d7db6f-fec5-4837-9ad8-943fb7d7eccb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050205 Aug 08 17:05:50.576423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 305/619] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:51.589559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:51.591720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:51.598561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:51.599043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:51.599486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:51.600217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:51.600678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:51.601110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:51.632951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3e2f957d-9804-44e9-b15f-d15036aca8e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048070 Aug 08 17:05:51.633685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 315/620] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:52.648491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:52.650721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:52.657428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:52.657944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:52.658390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:52.659094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:52.659550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:52.659972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:52.702730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-833fbfba-1e71-47d9-aa1a-4c177a596204 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057882 Aug 08 17:05:52.704283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 306/621] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:53.715632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:53.717822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:53.724298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:53.724786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:53.725220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:53.725959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:53.726414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:53.726846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:53.757154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a0d33666-3da5-4b4b-b23b-9ac9477a45db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045593 Aug 08 17:05:53.757732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 316/622] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:54.770338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:54.772440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:54.780062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:54.780543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:54.780974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:54.781671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:54.782158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:54.782572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:54.816654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-255add48-6320-4086-ae3d-dfabc6cb466c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050212 Aug 08 17:05:54.817230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 307/623] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:05:55.829495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:55.831672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:55.838763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:55.839252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:55.839692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:55.840393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:55.840851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:55.841283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:55.872446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-68cfcf3a-19fd-4406-a2f9-a57b41d0c397 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047014 Aug 08 17:05:55.873029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 317/624] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:56.885584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:56.887878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:56.894549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:56.895040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:56.895476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:56.896201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:56.896760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:56.897202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:56.929580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de5b2c74-cc86-4265-a9a7-bad16eb3d0c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048581 Aug 08 17:05:56.930431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 308/625] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:05:57.943160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:57.945250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:57.952731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:57.953223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:57.953696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:57.954442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:57.954900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:57.955326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:57.987715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-db5eeb7d-bd29-4a78-bb5e-8d28ee01329e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048488 Aug 08 17:05:57.988263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 318/626] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:05:59.000454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:05:59.003335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:05:59.010064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:59.010556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:59.010998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:59.011710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:05:59.012216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:05:59.012735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:05:59.045381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-25024a96-9176-46cc-8012-271284eddcd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048967 Aug 08 17:05:59.045997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 309/627] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:05:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:00.058009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:00.060323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:00.067686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:00.068165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:00.068599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:00.069289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:00.069744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:00.070195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:00.099859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-837fd91c-dc86-4e0f-9f83-a7a4209665c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045854 Aug 08 17:06:00.100338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 319/628] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:01.113045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:01.115251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:01.121889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:01.122379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:01.122811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:01.123501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:01.123957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:01.124432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:01.158737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8d50e91-01ff-4708-8417-db59245cd2f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049691 Aug 08 17:06:01.159346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 310/629] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:02.171901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:02.174053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:02.181415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:02.200312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:02.200312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:02.200312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:02.200312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:02.200734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:02.213063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eefcaf11-f49a-4568-8b76-70d19e7c239a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045242 Aug 08 17:06:02.213621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 320/630] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:03.226507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:03.228648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:03.235726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:03.236210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:03.236644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:03.237335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:03.237805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:03.238230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:03.268174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2aed261a-c77a-481f-b9e2-ff8bd1a73552 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045604 Aug 08 17:06:03.268743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 311/631] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:04.281129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:04.283339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:04.285751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=31 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:04.290851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:04.291333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:04.291775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:04.292474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:04.293037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:04.293563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:04.323402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f63ec8f1-58f3-4e12-8018-e206e53d9fc9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046516 Aug 08 17:06:04.324642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 321/632] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:05.336809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:05.338921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:05.342982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=31 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:05.347734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:05.348328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:05.348796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:05.349603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:05.350074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:05.362788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:05.376335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:05.380848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40fb4fbe-0e2d-4e89-9237-06c9db58c26d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048091 Aug 08 17:06:05.381404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 312/633] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:06.393132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:06.395231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:06.403097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:06.403588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:06.404028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:06.404733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:06.405191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:06.405615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:06.408244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:06.436827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7be137f2-a55d-4625-b018-0c604bdd1f95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047709 Aug 08 17:06:06.437393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 322/634] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:07.134657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:07.135162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:07.143428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.143974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.144410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.145107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.145559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.146009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.170401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0045265a-419d-4241-892e-fe140333804f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.039533 Aug 08 17:06:07.170973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 313/635] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:06:07 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:07.182645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aa76cac-2774-4f95-8f69-b8c5e5ec241d"}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:07.185573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:07.191703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.192179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.192612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.193297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.193753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.194199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.274252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: POST /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/os-volume_attachments HTTP/1.1 Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 74 Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:06:07.276080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {"volumeAttachment": {"volumeId": "8aa76cac-2774-4f95-8f69-b8c5e5ec241d"}} Aug 08 17:06:07.277622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '637a5c03-c639-4da1-8b40-5f1ac17b21ab', 'body': {'volumeAttachment': {'volumeId': '8aa76cac-2774-4f95-8f69-b8c5e5ec241d'}}} Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:06:07.278587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:07.280013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 400 to user: Invalid volume: volume 8aa76cac-2774-4f95-8f69-b8c5e5ec241d is already attached to instances: 97c06d12-050a-4dbb-9d04-30953de7661e {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7c92dc01-7129-42e3-a723-819ba93bfe17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099274 Aug 08 17:06:07.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 323/636] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:06:07 2022] POST /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:06:07.286613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:07.287110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:07.293337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.293842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.294779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.295463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.295912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.296333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.320966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:06:07.450497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:07.452712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:07.461088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.461580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.462143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.465510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.465510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.465510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.493363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0e6f15b2-c734-4c14-93bf-4ab8c110cfb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047023 Aug 08 17:06:07.493944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 324/637] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:07.620763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30f07c80-d781-492d-b1c6-041cf39a736b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 204 len: 0 microversion: 2.1 time: 0.337863 Aug 08 17:06:07.621353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 314/638] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:06:07 2022] DELETE /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:06:07.629933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:07.635328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:07.636504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.637033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.637384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.638103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:07.638566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:07.638992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:07.768494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:07.775938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6bcc5b55-9037-499f-a8fd-515957ddcb1d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.149862 Aug 08 17:06:07.776497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 325/639] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:07 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:08.507356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:08.509601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:08.517246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:08.517736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:08.518220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:08.518916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:08.519372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:08.519802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:08.549090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc88f241-d232-49ca-b632-d7e34ac3cbb1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Aug 08 17:06:08.549856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 315/640] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:08.798582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:08.799124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:08.805532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:08.806047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:08.806478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:08.807159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:08.807608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:08.808101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:08.939896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:08.947865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b0e91f3a-3047-4d53-9883-700b47fc7193 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.153706 Aug 08 17:06:08.948441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 326/641] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:08 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:09.562053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:09.564177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:09.570518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:09.570996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:09.571458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:09.572143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:09.572592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:09.573009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:09.602759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2cc8b267-2f0f-4a16-b468-a68e7f7792ad tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044819 Aug 08 17:06:09.603306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 316/642] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:09.968747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:09.969359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:09.975588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:09.976059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:09.976493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:09.977175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:09.977626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:09.978077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:10.106354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:10.113988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-85d01327-4007-481f-85ca-b4c717b588b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.149075 Aug 08 17:06:10.114557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 327/643] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:09 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:10.615240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:10.617458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:10.623873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:10.624357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:10.624794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:10.625489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:10.625974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:10.626401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:10.655690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-097f94bb-2381-4e14-b1b5-945b6732f2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044483 Aug 08 17:06:10.660316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 317/644] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:11.135647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:11.136251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:11.142764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:11.143249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:11.143690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:11.144383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:11.144844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:11.145272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:11.280107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:11.288016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-74c23456-bd8e-48cb-9f24-aae9279a613e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.156217 Aug 08 17:06:11.288590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 328/645] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:11 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:11.667534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:11.670407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:11.676738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:11.677223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:11.677660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:11.678376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:11.678829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:11.679254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:11.707446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8e34afc-3b97-4099-a6da-e28c871bc096 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044210 Aug 08 17:06:11.707985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 318/646] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:12.309569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:12.310146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:12.316986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:12.317494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:12.317965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:12.318647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:12.319098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:12.319517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:12.452785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:12.460319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-66749384-434c-4eeb-8da6-3e85f77530f8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.154703 Aug 08 17:06:12.460882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 329/647] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:12 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:12.719682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:12.721832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:12.728185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:12.728663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:12.729097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:12.729952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:12.730410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:12.730830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:12.760082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7238f7fd-fa17-4327-9564-ab88c863b94c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Aug 08 17:06:12.760626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 319/648] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:13.480404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:13.481025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:13.487352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:13.487874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:13.488226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:13.488913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:13.489367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:13.490166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:13.622297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:13.629830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87a640a8-cafe-4843-93de-d638b1b5a089 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.153308 Aug 08 17:06:13.630390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 330/649] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:13 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:13.772281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:13.774410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:13.780729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:13.781211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:13.781649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:13.782362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:13.782809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:13.783224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:13.811769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-896db212-9718-4173-a57c-e1d7176880df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043463 Aug 08 17:06:13.812310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 320/650] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:14.651369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:14.651914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:14.660851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:14.661341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:14.661827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:14.662533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:14.662989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:14.663416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:14.795656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:14.803101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1221346b-01f5-4200-b978-a0f8c14bc870 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.155704 Aug 08 17:06:14.803661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 331/651] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:14 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:14.824153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:14.826392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:14.833549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:14.834056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:14.834492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:14.835189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:14.835635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:14.836053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:14.864744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1d3bf75-995a-486c-90e0-fa06ea9b864e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Aug 08 17:06:14.865289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 321/652] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:15.825167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:15.825689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:15.832293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:15.832787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:15.833233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:15.833978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:15.834438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:15.834900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:15.878199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:15.881173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:15.888077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:15.889627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:15.890241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:15.891136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:15.891905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:15.892499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:15.925337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5965d3ae-d744-4ec3-88ea-73d25805e3b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052073 Aug 08 17:06:15.925852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 322/653] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:15.981086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:15.989442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-94bff9ed-8ef3-473b-95d2-723dd4fe5ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.168494 Aug 08 17:06:15.990055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 332/654] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:15 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:16.938256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:16.940325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:16.946385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:16.946866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:16.947303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:16.947989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:16.948449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:16.948867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:16.979887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d363b52d-ed6a-4d9e-aa8c-9e4e09a4aac2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046080 Aug 08 17:06:16.980437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 323/655] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:17.019555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:17.020165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:17.026763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:17.027246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:17.027681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:17.028368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:17.028817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:17.029244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:17.158155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:17.165889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cd668e2a-7b13-4e7a-baac-0c912927ddac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.150243 Aug 08 17:06:17.166505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 333/656] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:17 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:17.999621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:18.001741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:18.008204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:18.008689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:18.009126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:18.009844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:18.010298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:18.010719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:18.039130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d50487a-b1a3-4317-b748-a281e5d9eeb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047436 Aug 08 17:06:18.039688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 324/657] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:18.187241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:18.188021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:18.194687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:18.195167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:18.195598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:18.196283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:18.196733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:18.197154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:18.328147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:18.335494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4d39dae9-80b2-4786-b8fe-05c51fc060ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.152117 Aug 08 17:06:18.336050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 334/658] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:18 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:19.051653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:19.053829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:19.060407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:19.060895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:19.061860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:19.062554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:19.063007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:19.063427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:19.092629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-79848ff3-c271-4bbb-84c7-e949201c0e6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Aug 08 17:06:19.093200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 325/659] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:19.356484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:19.357009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:19.364034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:19.364508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:19.364941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:19.365617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:19.366092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:19.366511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:19.493666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:19.501919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-936ab9c9-e971-45f9-8096-ccc442af529c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.149271 Aug 08 17:06:19.502514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 335/660] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:19 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:20.105171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:20.107381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:20.114295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:20.114768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:20.115195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:20.115870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:20.116346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:20.116763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:20.145059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f009a299-1c44-48b6-9f32-5aa0a1cb9800 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043919 Aug 08 17:06:20.145614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 326/661] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:20.523060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:20.523669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:20.531113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:20.531605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:20.532036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:20.532748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:20.533201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:20.533633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:20.669662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:20.677802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d3094b01-9825-4857-bc20-74a3aa310769 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.158521 Aug 08 17:06:20.682304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 336/662] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:20 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:21.157526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:21.159671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:21.166295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:21.166789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:21.167296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:21.167986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:21.168436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:21.168858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:21.197176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ab610648-b28a-4f5c-ae02-40c58a51876e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Aug 08 17:06:21.197727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 327/663] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:21.699872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:21.700519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:21.707047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:21.707546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:21.707978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:21.708679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:21.709137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:21.709573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:21.841122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:21.848650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c2ed4a80-a8ea-4955-afa7-36436f317cd5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.152678 Aug 08 17:06:21.849219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 337/664] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:21 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:22.208711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:22.210846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:22.217145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:22.218175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:22.218622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:22.219287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:22.219736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:22.220155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:22.223771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:22.249807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-746564d5-3dcc-4c8d-ac33-5e98a74be2f7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045077 Aug 08 17:06:22.250354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 328/665] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:22.870418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:22.871033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:22.878336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:22.878825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:22.879293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:22.879993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:22.880447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:22.880869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:23.016371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:23.018674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:23.024461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b74ac778-58cd-48a3-8324-748d93c07a12 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.158056 Aug 08 17:06:23.025016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 338/666] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:22 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:23.262437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:23.265078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:23.272763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:23.273240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:23.273665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:23.274383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:23.274829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:23.275245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:23.304975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2f1962d-43ad-481f-b6c8-3406e935fb68 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046902 Aug 08 17:06:23.305523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 329/667] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:24.046320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:24.046952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:24.055096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:24.055096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:24.055096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:24.055394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:24.055840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:24.056267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:24.187764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:24.195344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c48f579c-2d35-4d17-9168-38b29ffa133e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.153450 Aug 08 17:06:24.195933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 339/668] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:24 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:24.318388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:24.320461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:24.327741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:24.328856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:24.329302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:24.330025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:24.330481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:24.330909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:24.358970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b917441-595e-43b8-be64-b885a78a1ee0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044742 Aug 08 17:06:24.359519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 330/669] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:25.216674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:25.217299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:25.224144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:25.227589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:25.227589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:25.227589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:25.227589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:25.227950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:25.358274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:25.365702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4cf8ffd0-14b2-4413-a604-2ef42c32dc1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.152951 Aug 08 17:06:25.366293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 340/670] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:25 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:25.371702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:25.374016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:25.380893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:25.381383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:25.381843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:25.382547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:25.382997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:25.383423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:25.414294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ffaf0318-fe1a-4a0a-9850-f954cd149f0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Aug 08 17:06:25.415133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 331/671] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:26.388777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:26.389346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:26.396011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:26.396497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:26.396939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:26.397634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:26.398121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:26.398547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:26.427300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:26.429444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:26.435814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:26.436292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:26.436721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:26.437409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:26.437883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:26.438301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:26.469750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-687aec81-9895-48a1-8b95-eec3510ab32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046275 Aug 08 17:06:26.470358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 332/672] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:26.532835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:26.540485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-63f1c3cf-fe6a-4ea4-81c5-5233461540f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.155835 Aug 08 17:06:26.541044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 341/673] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:26 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:27.481686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:27.489849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:27.490793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:27.491290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:27.491718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:27.492408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:27.492866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:27.493281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:27.523104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f474b744-4f3b-4be8-ad6d-30b4066d09a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045356 Aug 08 17:06:27.523670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 333/674] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:27.562655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:27.563267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:27.569877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:27.570365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:27.570806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:27.571500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:27.571960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:27.572397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:27.700206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:27.707685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3767811c-ad26-44f7-be1b-28a255992268 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.148962 Aug 08 17:06:27.708189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 342/675] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:27 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:28.535791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:28.537860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:28.544618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:28.545099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:28.545533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:28.546246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:28.547372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:28.547793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:28.575539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-83d8fb03-2e31-4406-b1fc-02f1835a5bb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043726 Aug 08 17:06:28.576071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 334/676] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:28.729549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:28.730189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:28.736704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:28.737184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:28.737617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:28.738336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:28.738794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:28.739220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:28.870777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:28.878163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4db97534-c0b6-43df-ac8a-9bb6b6fdbfc2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.152393 Aug 08 17:06:28.878723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 343/677] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:28 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:29.587618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:29.589812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:29.596848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:29.597344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:29.597842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:29.598552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:29.599009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:29.599438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:29.628576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d6b8f3a-3ec9-4cac-8a53-58dd03568fbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044937 Aug 08 17:06:29.629148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 335/678] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:29.899972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:29.900612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:29.907384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:29.907867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:29.908312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:29.909003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:29.909452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:29.909890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.039864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:30.047441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62cff8bb-1e64-4bff-ad49-0b17ec67a086 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.151464 Aug 08 17:06:30.051264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 344/679] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:29 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:30.641107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:30.643286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:30.649477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.654030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:30.654030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.654030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.654030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:30.654379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.681694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-23c59e95-7d6c-44da-9cf8-2db02912c8ae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044789 Aug 08 17:06:30.682457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 336/680] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:31.069410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:31.070109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:31.115505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.115505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.115505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.115505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.115868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.115868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.349384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:31.358656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2191bbfd-7d43-4ba5-9212-f3e250ba4d8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1681 microversion: 2.1 time: 0.293203 Aug 08 17:06:31.365840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 345/681] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:31 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:31.538984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:31.541097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:31.547590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.548086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.548528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.549229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.549688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.550149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.573038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'flavor' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:06:31.694133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:31.696531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:31.703736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.704429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.704882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.705568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.706056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.706486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.735679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0643dc7e-ca86-4864-b45a-5b367e71300b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Aug 08 17:06:31.736227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 346/682] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:31.968041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2b14e69e-5236-4a15-85d1-81a5c1b91b83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action" status: 200 len: 32 microversion: 2.1 time: 0.426924 Aug 08 17:06:31.973704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:31.974643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:31.976601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 337/683] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:06:31 2022] POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:06:31.986162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.987250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.989353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.990357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:31.993418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.998535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.230441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:32.240287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-34d9efa0-7c09-4102-9b18-f1a24df7d15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.272074 Aug 08 17:06:32.257374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 347/684] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:32.285123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637a5c03-c639-4da1-8b40-5f1ac17b21ab", "name": "network-vif-deleted", "tag": "e07f5704-fa0e-4d29-a752-85d47d463662"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:32.298486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.299207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.299816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.314581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] Creating event network-vif-deleted:e07f5704-fa0e-4d29-a752-85d47d463662 for instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab on hv-cinder-85221 Aug 08 17:06:32.323030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-e34e731f-2dac-49bc-88e3-cefa077b8119 req-7473f9f8-abb9-4a6f-9a53-3b82c7595d2c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122185 Aug 08 17:06:32.324247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 338/685] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:32.387188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:32.387873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:32.395490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.395990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.396437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.397208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.397674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.409511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.492448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:32.501122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b643caea-1d24-4aa9-9d7d-d120610af761 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1613 microversion: 2.1 time: 0.123303 Aug 08 17:06:32.501697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 348/686] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:32 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:32.751023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:32.753605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:32.760436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.760932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.761373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.762119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.762754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.763186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.795748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-397b6818-74a9-4067-8f9d-7d82cbc61d86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051445 Aug 08 17:06:32.796316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 339/687] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:33.264542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:33.265736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:33.276850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.277659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.278445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.279413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.279880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.280522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.458785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:33.467554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02c3b5a5-bfaa-4641-bfc7-b47caf2e9e5a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.206845 Aug 08 17:06:33.468151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 349/688] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:33.524419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:33.525216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:33.531479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.531963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.532391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.533090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.533688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.534185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.567723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.568207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.568644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.569093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lazy-loading 'fault' on Instance uuid 637a5c03-c639-4da1-8b40-5f1ac17b21ab {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:06:33.615303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:33.623339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ff5be36-5cb9-4d15-8da5-0d894ce7e6e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1331 microversion: 2.1 time: 0.104539 Aug 08 17:06:33.624000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 340/689] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:33 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:33.808895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:33.812457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:33.818940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.819565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.820007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.821024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.821494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.821954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.852643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d41516b3-dda6-41d6-bb79-14177b3bd67c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047762 Aug 08 17:06:33.853602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 350/690] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:34.490069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:34.490821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:34.497157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.497642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.498110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.498803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.499258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.499684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.636684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:34.644885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:34.645435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-72deb5a4-0a4b-4011-9cc6-80c83c44032e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.159292 Aug 08 17:06:34.645627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:34.646027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 341/691] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:34.652733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.653231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.654287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.654391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.654898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.655321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.687707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.688190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.688624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.689070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lazy-loading 'fault' on Instance uuid 637a5c03-c639-4da1-8b40-5f1ac17b21ab {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:06:34.732475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:34.739649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-01b8ab68-85b9-4eaa-be1d-3e4d8fae7bc1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 200 len: 1331 microversion: 2.1 time: 0.098547 Aug 08 17:06:34.740208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 351/692] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:34 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:34.865061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:34.867295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:34.873382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.873894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.874324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.875025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.875470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.875890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.904727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-13977b3d-ccca-4c74-886d-f30f96c82932 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043512 Aug 08 17:06:34.905286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 342/693] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:35.668094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:35.668712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:35.675712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.676201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.676645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.677341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.677822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.678259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.760511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:35.768046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:35.768046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.768334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.768565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.769264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.769719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.770178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.774365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:35.784484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab HTTP/1.1 Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:06:35.786145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:06:35.787763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '637a5c03-c639-4da1-8b40-5f1ac17b21ab'} Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:06:35.788879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:06:35.790447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.792445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:06:35.792445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-458189ba-e647-426a-9655-988bc05374bc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 08 17:06:35.792445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 343/694] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:35 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:06:35.797823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1d38e73-1519-4523-bb91-4f098af63aaf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '.version_select at 0x7f743891d0d0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:35.810006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:35.818086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-55a05034-bf10-4906-b411-3113f052268b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153766 Aug 08 17:06:35.818655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 352/695] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:35.884400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1d38e73-1519-4523-bb91-4f098af63aaf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694917514" status: 202 len: 0 microversion: 2.1 time: 0.090763 Aug 08 17:06:35.884979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 344/696] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Aug 8 17:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694917514 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:06:35.918295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:35.920496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:35.927191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.927682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.928149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.928852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.929308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.929734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.958027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ac7bb185-3ee5-4fbc-ba4d-041a9e50a32c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043741 Aug 08 17:06:35.958795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 353/697] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:36.695920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:36.696417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:36.705193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.705675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.706132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.706824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.707277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.707704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.786075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lazy-loading 'services' on Instance uuid 97c06d12-050a-4dbb-9d04-30953de7661e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:06:36.839446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:36.840061 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:36.842370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=68 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:36.847485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.847967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.849418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.849418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.849728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.850178 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.978942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:36.987221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f2aa4c09-f109-42fb-82ac-9fee8dba33c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151616 Aug 08 17:06:36.987766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 354/698] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:36.991585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dd057327-0f98-45fb-aaef-790e576722d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments/8aa76cac-2774-4f95-8f69-b8c5e5ec241d" status: 202 len: 0 microversion: 2.1 time: 0.298581 Aug 08 17:06:36.991585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 345/699] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:06:36 2022] DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments/8aa76cac-2774-4f95-8f69-b8c5e5ec241d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:06:36.996706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:36.996706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:37.000890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:37.001391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:37.001970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:37.002681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:37.003147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:37.003577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:37.007492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:37.010516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:37.013314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:37.020061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:37.020542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:37.023150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:37.023150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:37.023150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:37.023150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:37.035165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e205850b-04db-4ed1-b7b5-9c26e6e7ae02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046322 Aug 08 17:06:37.035740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 355/700] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:37.056683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a378cad8-128b-4ead-a2de-1d7e091f1db1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050602 Aug 08 17:06:37.057228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 346/701] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:38.009607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:38.010261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:38.019053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.019544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.019982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.020680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.021138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.021564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.047266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:38.049397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:38.051854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:38.056632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.069511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.069511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.069511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.069511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.070057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.091436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-983dcc06-c0a2-4935-bc6c-605149513c84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048080 Aug 08 17:06:38.092025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 347/702] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:38.101598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:38.103942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:38.110474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.110981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.111425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.112133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:38.112599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:38.113019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:38.144807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-478a8dd6-718a-4ccc-ae5f-28a23fe45975 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051718 Aug 08 17:06:38.145581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 348/703] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:38.162037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:38.170348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a2b8f22e-d6f7-41fe-a0ed-93e0cc59686c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.164624 Aug 08 17:06:38.170909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 356/704] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:39.105670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:39.107911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:39.115562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.116056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.116500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.117210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.117670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.118128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.149020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0b917bd0-14bb-4313-846c-19fa9073b9fb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047283 Aug 08 17:06:39.149597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 349/705] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:39.157292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:39.159568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:39.166382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.166874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.167314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.168013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.168471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.168893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.191812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:39.192432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:39.198763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.199007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aca43af8-8542-4caa-8657-d59e84d0f3d7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 08 17:06:39.199291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.199416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 357/706] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:39.199736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.200446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:39.200908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:39.201336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:39.335159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:39.343911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1c5a566-99ee-41a2-a920-270e72fba334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155262 Aug 08 17:06:39.344480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 350/707] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:40.161522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:40.164173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:40.170755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.171758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.172199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.172897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.173344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.173764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.204718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5f535e18-1db9-4d81-8ca0-278e6ce0fb32 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047041 Aug 08 17:06:40.205454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 358/708] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:40.211792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:40.214132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:40.221223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.221715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.222180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.222883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.223339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.223766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.254385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c3e21d2-7431-4d64-a26c-f020a912200a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Aug 08 17:06:40.254963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 351/709] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:40.365189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:40.365812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:40.371835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.372319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.372751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.373442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:40.373917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:40.374340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:40.506823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:40.515102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c03c79dc-8dc4-4775-a37a-dce6a75f9066 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153646 Aug 08 17:06:40.515685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 359/710] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:41.216844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:41.219071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:41.225659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.226175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.226609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.227300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.227746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.228162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.258725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e19dac22-315b-4c2e-b17f-e84dd49739bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045860 Aug 08 17:06:41.259296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 352/711] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:41.267560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:41.269692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:41.276277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.276760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.277192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.277903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.278355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.278774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.307079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc1b6503-0c24-496c-8803-fa086728ea7b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 08 17:06:41.307616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 360/712] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:41.537091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:41.537623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:41.544054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.544539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.544972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.545662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.546155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.547069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.682770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:41.691902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad03af6f-3580-4cfe-a8f9-aa2812d2483d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.158902 Aug 08 17:06:41.692486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 353/713] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:42.271359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:42.273503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:42.280006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.280492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.282171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.282320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.282778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.283205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.313980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a922de10-6026-49ec-a7cc-4e0ca7d088d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046531 Aug 08 17:06:42.314526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 361/714] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:42.319470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:42.321563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:42.328438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.328915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.329350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.330076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.330525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.331039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.360651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9bbcad8-7107-42c9-8c61-1ffce70403bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Aug 08 17:06:42.361202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 354/715] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:42.712596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:42.713138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:42.719328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.719816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.720255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.720963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.721418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.721864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.855328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:42.863776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9185ea1-9c39-46b7-91b9-a029057e6716 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155161 Aug 08 17:06:42.864336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 362/716] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:43.326124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:43.328297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:43.335004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.335487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.335923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.336622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.337084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.337511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.370443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35f448d8-4e56-4a51-9ce4-0ac038ed3bdc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048267 Aug 08 17:06:43.371170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 355/717] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:43.373240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:43.375491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:43.382036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.382453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.382889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.383612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.384062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.384486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.416819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-156e265b-d5fc-49a6-8f32-af19392809ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Aug 08 17:06:43.417401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 363/718] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:43.886014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:43.886630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:43.893220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.893739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.894212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.894912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.895367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.895792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.030908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:44.039396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76666f58-d0e7-4021-9668-2062c5116d8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157387 Aug 08 17:06:44.039974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 356/719] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:44.383728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:44.385809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:44.392364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.392896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.393322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.394060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.394516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.394943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.426275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b307e843-59f3-4723-93bd-7398e62c0c4c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 Aug 08 17:06:44.426853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 364/720] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:44.430002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:44.432297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:44.439709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.440190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.440619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.441310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.441758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.442202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.472319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1799590a-3a03-4bc2-a5d2-f381022edff2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046247 Aug 08 17:06:44.472895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 357/721] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:45.062630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:45.062630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:45.068830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.069326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.069816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.070547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.071010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.071440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.212704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:45.221718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-18ae5b61-28c6-48c6-b935-ac0b4acb3a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.163893 Aug 08 17:06:45.222338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 365/722] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:45.439720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:45.441877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:45.448530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.449015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.449490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.450256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.450714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.451143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.483844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c2b3b9e0-4fb5-45f4-8c8f-402081ce8f1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048989 Aug 08 17:06:45.484410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 358/723] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:45.485174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:45.487642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:45.494720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.495255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.495728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.496489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.497075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.497593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.529125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3c4187b6-335d-4147-9abe-5b4d11dcc1ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048625 Aug 08 17:06:45.529688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 366/724] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:46.244156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:46.244918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:46.251509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.251993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.252456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.253136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.253650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.254170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.388900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:46.397094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99d61d0e-6c16-4e25-8e9f-a1952906e702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157285 Aug 08 17:06:46.400798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 359/725] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:46.497245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:46.499522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:46.506060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.506550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.506986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.507679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.508131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.508599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.538627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-009b9f6f-64ab-4e85-9889-e2967a84f94a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045753 Aug 08 17:06:46.539181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 367/726] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:46.541989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:46.544350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:46.550955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.551434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.551866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.552553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:46.553010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:46.553434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.577879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:46.582728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e774466-8e70-435a-8863-817ae724a86e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Aug 08 17:06:46.583288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 360/727] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:47.419456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:47.419992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:47.426760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.427248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.427687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.428382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.428834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.429257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.551975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:47.554185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:47.561489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.562018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.562458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.567563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.567563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.567563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.570719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:47.583898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2dda78c-614e-40c5-bd44-31c18d54de41 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.168616 Aug 08 17:06:47.588837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 368/728] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:47.603663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:47.605862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:47.607603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f845ab77-d8cf-43f0-8ced-66980e5b9d85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060465 Aug 08 17:06:47.608276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 361/729] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:47.612577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.613069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.613508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.614240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.614702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.615123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.645518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-58217d1b-3bac-4e50-9961-0d625cb62d17 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Aug 08 17:06:47.646116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 369/730] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:48.604961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:48.605576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:48.612029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.612515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.612955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.613645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.614164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.614591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.622899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:48.625044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:48.631997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.632492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.632939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.633639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.634124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.634552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.664562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e4d9cd48-da3f-4d4c-a2c0-d106d79c60f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045412 Aug 08 17:06:48.665042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 370/731] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:48.671801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:48.677472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.677999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.678437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.679130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.679585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.680012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.705825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:48.716009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b9a25e22-8576-4a5f-94b9-45ed77f02626 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049895 Aug 08 17:06:48.716621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 371/732] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:48.749653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:48.758222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dccb64b0-75dc-4554-8919-f2f22ff45599 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157143 Aug 08 17:06:48.758778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 362/733] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:49.677361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:49.679554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:49.686196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.686678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.687111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.687797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.688247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.688667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.717328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b9a4af4e-f246-4773-bf5b-8d06a468b6e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044440 Aug 08 17:06:49.717921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 372/734] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:49.742404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:49.744530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:49.753042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.753530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.753992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.754694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.755145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.755566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.785027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c58a00f6-f7d1-4968-bce6-c3d665e5ba8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Aug 08 17:06:49.785581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 363/735] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:49.787475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:49.788093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:49.794330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.794824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.795265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.795966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.796433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.796855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.930029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:49.939453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5ef882d4-b6a0-4bbd-b906-8ffcaf667236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155696 Aug 08 17:06:49.940031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 373/736] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:50.730178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:50.732467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:50.738985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.739461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.739891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.740575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.741028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.741446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.769534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63b56233-016a-4b0b-a85c-cf15e9e56197 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043468 Aug 08 17:06:50.770173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 364/737] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:50.796462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:50.799275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:50.805872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.806368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.806816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.807507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.807970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.808399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.836848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8eb502e5-b171-48d3-b6fa-3607fe7ecb6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 08 17:06:50.837404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 374/738] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:50.960640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:50.961287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:50.967391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.967872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.968305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.968991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.969970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.970399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.100934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:51.111600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6b55d3f-a277-49ca-9ab7-402fcdc823a8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154203 Aug 08 17:06:51.117776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 365/739] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:51.780796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:51.784842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:51.791032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.791506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.791937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.792623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.793069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.793490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.822218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-51c9f57f-841c-4cfc-be2c-c12e7573134c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045325 Aug 08 17:06:51.822814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 375/740] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:51.848592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:51.850690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:51.857081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.857562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.858038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.858723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.859171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.859592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.889857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8a7541a2-9a6c-45e5-ae0d-75c84264a9c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 08 17:06:51.890537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 366/741] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:52.132836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:52.133388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:52.139808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.140054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.140500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.141259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.141702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.142129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.275986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:52.284454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4ac129b3-6aff-458a-a970-af9e68dcd87f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155541 Aug 08 17:06:52.285011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 376/742] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:52.837332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:52.839610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:52.846133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.846635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.847066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.847746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.848198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.848614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.877081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21483038-3933-4481-ad5f-f5af0ebb71a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045577 Aug 08 17:06:52.877872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 367/743] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:52.902258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:52.904445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:52.911495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.911977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.912415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.913105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:52.913860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:52.914287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.943139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-37ac61d9-06e6-4121-b0c6-c8ac75326616 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Aug 08 17:06:52.943702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 377/744] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:53.306138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:53.306758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:53.312665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.313643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.314210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.314904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.315363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.315792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.452579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:53.460385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44ca0b03-08e5-46ec-a578-1cfc8291ffc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.158204 Aug 08 17:06:53.460940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 368/745] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:53.888694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:53.890893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:53.896762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.897245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.897678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.898385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.898838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.902265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.928792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6ca1fe23-5469-4f95-beaf-b430784ec497 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Aug 08 17:06:53.929426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 378/746] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:53.956597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:53.958751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:53.965273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.965757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.966238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.966908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.967362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.967784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.999152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c61934b6-3754-4747-a90a-9349a4a850ed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Aug 08 17:06:53.999757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 369/747] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:54.481682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:54.482444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:54.488307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.488786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.489219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.489941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.490399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.490821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.620921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:54.629389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1dde4282-c8c8-4ee7-b6f7-3e2aa281a8fd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1718 microversion: 2.1 time: 0.151589 Aug 08 17:06:54.629971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 379/748] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:54.688777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:54.689263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:54.695098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.695571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.696004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.696684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.697170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.697592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.789016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Cannot 'detach_volume' instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e while it is in vm_state rescued Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:06:54.790649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:06:54.792215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Cannot 'detach_volume' instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e while it is in vm_state rescued Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:06:54.793025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e while it is in vm_state rescued Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e while it is in vm_state rescued Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:06:54.794567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 409 to user: Cannot 'detach_volume' instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e while it is in vm_state rescued {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:06:54.796071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a76695f-44df-4265-a673-cfb1c1d8b81e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 409 len: 152 microversion: 2.1 time: 0.107731 Aug 08 17:06:54.796071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 370/749] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:06:54 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 17:06:54.800915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:54.801448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:54.807453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.807926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.808359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.809039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.809488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.809998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.942405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:54.944448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:54.951197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.951679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.952115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.952807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.953259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.953682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.983009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb2409c0-bd3f-4827-9bdd-7921769d13b8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045943 Aug 08 17:06:54.983646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 371/750] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:06:55.011117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:55.013330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:55.013473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-49b752ed-d195-4bfc-a446-2bf0ff265a49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.216188 Aug 08 17:06:55.014237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 380/751] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:06:54 2022] POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:06:55.019318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.024183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.024183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.024183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.024183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.024565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.024644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:55.024644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:55.029608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.030167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.031105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.031318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.031771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.032196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.051993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed9f1482-1e7b-45a2-961b-353c8b488f60 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Aug 08 17:06:55.058610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 372/752] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:06:55.164955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:55.174519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c5c27db5-864f-4be9-b2ac-0515c840488d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1726 microversion: 2.1 time: 0.155547 Aug 08 17:06:55.175197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 381/753] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:55.996157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:55.998329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:56.005232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.005717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.006190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.006879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.007334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.007755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.036231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9235e7ea-620f-4543-8ffa-685c6519e8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044059 Aug 08 17:06:56.036772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 373/754] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:56.065205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:56.067394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:56.073882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.074376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.074821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.075549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.076013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.076441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.105659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0c4d7c99-7763-4bd2-a79f-397289ea83c9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Aug 08 17:06:56.106237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 382/755] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:56.196355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:56.196968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:56.203030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.203567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.204627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.205387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.205929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.206357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.334139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:56.342127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c49c7276-14c7-4f7a-aeb0-9609b2e46f6c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1726 microversion: 2.1 time: 0.149405 Aug 08 17:06:56.342690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 374/756] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:57.048688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:57.050833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:57.056839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.057322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.057758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.058532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.058984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.059406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.089089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f47747cb-7dea-42a0-beda-0b2a3e10a9f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044905 Aug 08 17:06:57.089901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 383/757] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:57.117713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:57.119933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:57.126393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.126923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.127311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.127994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.128446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.128866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.158550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84cc96b5-c875-43a5-b914-e3d25b8ddd6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Aug 08 17:06:57.159098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 375/758] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:57.362595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:57.363215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:57.369285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.369816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.370285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.370972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.371432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.371856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.511979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:57.521046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a0f4fb43-255d-426b-9657-d8fa471d475d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1726 microversion: 2.1 time: 0.162319 Aug 08 17:06:57.521669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 384/759] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:58.101635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:58.103698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:58.109758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.110271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.110710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.111924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.112380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.112803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.142600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8c799ea-0d5f-4182-a1e1-40bb14d79791 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044965 Aug 08 17:06:58.143292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 376/760] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:58.171075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:58.173208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:58.180352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.180846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.181285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.182442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.182585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.182907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.212603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8f48fecd-bd01-4170-8b51-b94bfb433f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Aug 08 17:06:58.213166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 385/761] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:58.542726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:58.543366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:58.549935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.550419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.550854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.551541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:58.551996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:58.552418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.570697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:58.684782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:58.692715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-58076d38-8f47-4a03-a5e2-8e0bab818942 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1726 microversion: 2.1 time: 0.154238 Aug 08 17:06:58.693280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 377/762] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:59.155185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:59.157323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:59.163609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.164091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.164528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.165218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.165667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.166115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.195119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd1c4916-4b8c-4a55-8b1c-0ccc1050be2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043928 Aug 08 17:06:59.195790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 386/763] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:06:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:06:59.224423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:59.226573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:59.232987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.233500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.233982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.234658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.235104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.235520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.263828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac4168b2-8f47-4d05-8fe1-c6a91dfaabf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Aug 08 17:06:59.264371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 378/764] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:06:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:59.714487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:59.715016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:59.721419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.721918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.722347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.723024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.723473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.723890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.739175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:59.852586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:59.860339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-df8f5157-f5a8-4ff7-b0a8-370f3e02ede7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1732 microversion: 2.1 time: 0.149724 Aug 08 17:06:59.860893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 387/765] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:59.881026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:59.881508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:59.887518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.887999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.888436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.889130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:59.889581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:59.890021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:59.967066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49f99014-0c91-403e-9ad1-f42ec8eaa46e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089914 Aug 08 17:06:59.967683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 379/766] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:06:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:00.208563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:00.210912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:00.217833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:00.218393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:00.218936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:00.219694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:00.220148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:00.220574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:00.249519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-faccb794-1e2f-48ec-b430-5217b21a9f97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045490 Aug 08 17:07:00.250100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 388/767] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:00.333481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:00.335979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:00.342084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:00.342576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:00.343017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:00.343727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:00.344243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:00.344672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:00.376101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-65a982c4-f4e6-4661-8571-abe52f842e3e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103396 Aug 08 17:07:00.376851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 380/768] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:00 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:01.195176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:07:01.204558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:01.205052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:01.205484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:01.217255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] Creating event network-changed:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:07:01.222988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-c5c1fe29-daca-4514-af24-e656a83964dc req-5409e8c2-a9b8-46bc-859a-fb7fb0b071fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087424 Aug 08 17:07:01.223547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 389/769] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:01.261625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:01.263828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:01.270123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:01.270864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:01.271304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:01.272001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:01.272629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:01.273060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:01.305428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-32bdd5cd-c7a2-4f69-bbf4-f60d7aa79682 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047679 Aug 08 17:07:01.306035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 381/770] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:01.389610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:01.393844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:01.416243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:01.416801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:01.417251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:01.418002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:01.418991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:01.418991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:01.455954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f6254ceb-c187-4038-891c-958ef63d2f58 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070333 Aug 08 17:07:01.460387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 390/771] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:02.317213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:02.319541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:02.326013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:02.326497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:02.326933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:02.327624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:02.328078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:02.328500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:02.357494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a935b4df-1ec9-442e-8f0e-54b455f32944 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044317 Aug 08 17:07:02.358081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 382/772] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:02.468043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:02.470246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:02.477333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:02.477850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:02.478294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:02.478990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:02.479449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:02.479875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:02.510677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c35b0ea8-692c-4511-85e1-f80aae2a7d48 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Aug 08 17:07:02.511279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 391/773] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:03.238194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:07:03.247408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:03.247886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:03.248311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:03.259648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] Creating event network-changed:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:07:03.264627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-d215bfb2-670b-43ba-80a4-afa1e6dc7f0b req-4f774066-db07-4002-b2c8-7f0827c0ae49 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030610 Aug 08 17:07:03.265193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 383/774] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:03.369923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:03.372107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:03.379054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:03.379054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:03.379448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:03.380147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:03.380609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:03.381033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:03.410958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dfc1a7f9-f9f3-49f7-9a9d-a9e3c1fd36a5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045007 Aug 08 17:07:03.411529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 392/775] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:03.524103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:03.526634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:03.532767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:03.533929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:03.534373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:03.535134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:03.535586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:03.536008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:03.565756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-183953e3-01ae-47a4-929f-07e9dd2c1f85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Aug 08 17:07:03.566342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 384/776] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:04.423523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:04.425591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:04.432056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:04.432540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:04.432982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:04.433667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:04.434158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:04.434585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:04.463664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f981402-af70-4ce0-99e3-88e5799c5d94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Aug 08 17:07:04.464214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 393/777] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:04.577674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:04.579827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:04.586315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:04.586802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:04.587239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:04.587935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:04.588391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:04.588816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:04.618830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a014913a-e49b-4c98-a58c-b0150310c029 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Aug 08 17:07:04.619433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 385/778] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:05.477114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:05.479427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:05.485802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:05.486287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:05.486721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:05.487400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:05.487853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:05.488271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:05.518760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5df0d3e7-1f6f-48fc-820b-1bb6e3553d70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045622 Aug 08 17:07:05.519315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 394/779] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:05.631121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:05.633280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:05.639677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:05.640155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:05.640589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:05.641328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:05.641806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:05.642241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:05.673992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8e7d63d-8915-4c82-b87d-d66562c7df10 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Aug 08 17:07:05.674557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 386/780] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:06.531170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:06.533901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:06.540586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:06.541078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:06.541522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:06.542335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:06.542795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:06.543223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:06.574120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2500e914-4b5d-42a2-879a-86aa320388e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046853 Aug 08 17:07:06.574697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 395/781] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:06.686410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:06.688517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:06.695256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:06.695731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:06.696158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:06.696842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:06.697404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:06.697841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:06.727534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ef2779cf-43a6-4155-a8cc-b298c7676de3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 08 17:07:06.728083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 387/782] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:07.586434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:07.588632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:07.594894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=84 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:07.596706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:07.597208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:07.597654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:07.598633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:07.599101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:07.599534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:07.630705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb82b095-2d26-40c1-8ff4-5e93370f714a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048353 Aug 08 17:07:07.631260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 396/783] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:07.740434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:07.742750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:07.749350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:07.749855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:07.750287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:07.750974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:07.751423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:07.752590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:07.780813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-97fc1951-52e2-4ad0-87fb-dc6060da410c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Aug 08 17:07:07.781359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 388/784] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:07 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:08.642840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:08.644959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:08.651555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:08.652034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:08.652469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:08.653157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:08.653607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:08.654058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:08.683399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8f4afe42-779f-4b34-a5d3-d00dc835896e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Aug 08 17:07:08.683940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 397/785] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:08.793236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:08.795408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:08.802753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:08.803232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:08.803692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:08.804373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:08.804821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:08.805235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:08.833604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5056a746-846a-49fb-9de0-119057c013b2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 08 17:07:08.834183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 389/786] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:09.696461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:09.698542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:09.705614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:09.706133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:09.706562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:09.707250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:09.707701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:09.708120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:09.745423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-65b29a90-b69f-4cfe-88fe-d4dea52d0cdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Aug 08 17:07:09.745423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 398/787] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:09.846335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:09.848508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:09.850958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:09.855800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:09.856285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:09.856713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:09.857415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:09.857894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:09.858339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:09.890675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03f560b9-84b8-4242-a09f-7b4359f90709 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048354 Aug 08 17:07:09.891237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 390/788] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:10.748907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:10.751085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:10.757966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:10.758449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:10.758884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:10.759565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:10.760016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:10.760435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:10.788813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f9c4bf79-7021-4960-a65f-0c08e150ab93 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Aug 08 17:07:10.789365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 399/789] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:10.902765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:10.904872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:10.911940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:10.912441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:10.913132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:10.913897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:10.914372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:10.914804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:10.945582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c92d27ad-942a-4407-a1d8-eb3a406635dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Aug 08 17:07:10.946204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 391/790] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:11.801392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:11.803709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:11.810392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:11.810869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:11.811315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:11.812014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:11.812473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:11.812904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:11.842504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-96520fc9-7f07-40f2-857b-91a75b643050 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044959 Aug 08 17:07:11.842992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 400/791] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:11.959009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:11.961160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:11.970871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:11.971359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:11.971800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:11.972499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:11.972947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:11.973368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:12.002807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-faec4ffb-d087-41e8-99a0-99885bf952d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048326 Aug 08 17:07:12.003384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 392/792] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:12.855027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:12.857105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:12.864011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:12.864499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:12.864942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:12.865645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:12.866131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:12.866593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:12.899801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3678d536-1e38-47d1-b21b-e4789e7a3c29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048816 Aug 08 17:07:12.900356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 401/793] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:13.015642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:13.017773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:13.024192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:13.024707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:13.025561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:13.025911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:13.026363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:13.026784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:13.056399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92a54802-d7c3-4a88-aa88-8e27a99cfb80 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Aug 08 17:07:13.056954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 393/794] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:13.913428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:13.915496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:13.921911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:13.922391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:13.922827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:13.923512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:13.923963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:13.924384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:13.952841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f37d7b2-b911-4f24-a40e-9eb1ef075f62 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043792 Aug 08 17:07:13.953382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 402/795] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:14.069232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:14.071384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:14.077914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:14.081050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:14.081050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:14.081050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:14.081050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:14.081389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:14.112463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7374c68-3ac5-43db-b2ee-079aa9459402 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047131 Aug 08 17:07:14.113020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 394/796] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:14.965865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:14.967988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:14.974845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:14.975331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:14.975775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:14.976462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:14.976920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:14.977346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:15.006570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-586b2dd3-7962-44ab-8893-60a9886a7988 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Aug 08 17:07:15.007120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 403/797] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:15.126561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:15.128712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:15.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:15.135806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:15.136238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:15.136930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:15.137384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:15.137825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:15.141486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:15.168603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7722f5e6-9107-4cb0-a6f4-e389e6fdf218 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 Aug 08 17:07:15.169375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 395/798] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:16.019340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:16.021512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:16.027764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:16.028254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:16.028691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:16.029567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:16.031665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:16.031665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:16.056365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:16.063161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-51334f0b-f98d-4c7d-bf48-d1bd1996a62c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047693 Aug 08 17:07:16.065825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 404/799] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:16.181555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:16.183651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:16.190536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:16.191030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:16.191472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:16.192172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:16.192635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:16.193062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:16.225641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-634fa5c0-6552-47c3-9288-baf655ae1195 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048655 Aug 08 17:07:16.226233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 396/800] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:17.076512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:17.078678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:17.086449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:17.086934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:17.087372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:17.088066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:17.088516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:17.089051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:17.117487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9e7a535a-14db-4d9a-97d7-4e713513bb5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044986 Aug 08 17:07:17.118097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 405/801] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:17.238076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:17.240320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:17.247072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:17.247555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:17.247992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:17.248681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:17.249135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:17.249557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:17.280634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1fffa635-c95b-45a2-87fb-c3c9e1fc996c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 08 17:07:17.281194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 397/802] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:18.130409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:18.132580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:18.139429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.139918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.140361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.141060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.141519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.141985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.173207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07c538aa-424f-4c41-8e84-6bc91745f939 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046987 Aug 08 17:07:18.173776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 406/803] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:18.293048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:18.295227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:18.304257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.305001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.305574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.306493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.307258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.307384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.316702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:07:18.317230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:18.324051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.324521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.324950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.325647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.326137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.326754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.350968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lazy-loading 'flavor' on Instance uuid e68ae2a9-75e7-4eba-b349-a5207bc78db2 {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:07:18.352958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b02e7979-a7a0-476a-b8fb-5f69413ea131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063970 Aug 08 17:07:18.358043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 398/804] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:18.624862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9652def9-897f-4e18-9d9f-8a106b2a3677 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "POST /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2/action" status: 202 len: 0 microversion: 2.1 time: 0.311958 Aug 08 17:07:18.625594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 407/805] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:07:18 2022] POST /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:07:18.637046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:18.638160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:18.644891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.645393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.645874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.646643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:18.647105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:18.647567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:18.787404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:18.795353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de9d9943-78e9-4c71-b089-cbc455aadb26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.163028 Aug 08 17:07:18.795914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 399/806] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:19.186673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:19.188871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:19.195057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.195546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.195992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.196692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.197151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.197583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.228283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc14d483-f20e-4c51-bb58-27ff31b01a16 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046473 Aug 08 17:07:19.228985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 408/807] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:19.366716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:19.368765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:19.375580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.376069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.376509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.377204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.377718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.378179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.406702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-afe4fdfe-9ac5-434c-819c-bd80bb5cb4f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 08 17:07:19.407265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 400/808] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:19.817038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:19.817650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:19.823740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.824217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.824645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.825328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:19.825779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:19.826224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:19.969583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:19.977493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5d6152ef-d9f1-4a54-b3a3-fddf2a91313a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.164273 Aug 08 17:07:19.978303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 409/809] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:20.240815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:20.242979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:20.248822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:20.249296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:20.249726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:20.250430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:20.250882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:20.251296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:20.281024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e21c50df-4653-42d0-82d3-9ed276c7bdb5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044104 Aug 08 17:07:20.281500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 401/810] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:20.419999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:20.422163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:20.429219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:20.429699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:20.430161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:20.430847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:20.431393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:20.431847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:20.461725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-992b84cc-0248-4479-b55c-e47068af551d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Aug 08 17:07:20.462379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 410/811] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:21.001430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:21.002101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:21.008557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.009042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.009478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.010207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.010658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.011088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.158339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:21.166835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f2c47fa-8c0c-4855-b088-5800cfb181a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.169325 Aug 08 17:07:21.167402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 402/812] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:07:21.294025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:21.296097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:21.302494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.302981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.303404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.304096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.304553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.304970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.335577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8c381cc9-1217-44ab-a043-1b83fc5e2b61 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045611 Aug 08 17:07:21.336337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 411/813] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:21.473841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:21.476029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:21.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.482439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.482878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.483558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:21.484008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:21.484427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:21.513381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09fae972-25d8-4a6d-ad77-5b7c985d7e5a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 08 17:07:21.513974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 403/814] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:22.188630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:22.189236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:22.195961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.196436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.196975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.197670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.198149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.198564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.329046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:22.336575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02b872fa-4b34-4a75-9246-1638dbacdc80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151886 Aug 08 17:07:22.337148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 412/815] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:22.348583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:22.350893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:22.357191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.357677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.358155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.358843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.359302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.359731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.388754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-13ad522a-4ca6-4371-886b-41a1351c1248 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044466 Aug 08 17:07:22.389232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 404/816] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:22.525921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:22.528117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:22.534531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.535009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.535442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.536123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:22.536576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:22.536995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:22.565062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0270cf06-c51c-4a38-95c3-3e04182f99dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Aug 08 17:07:22.565598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 413/817] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:23.358103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:23.358726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:23.365078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.365559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.366028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.366709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.367158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.367579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.401042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:23.403129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:23.410346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.410821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.413927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.413927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.413927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.413927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.443169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-08e5afa5-5ac7-4985-afc7-19835846c5ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046089 Aug 08 17:07:23.443795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 414/818] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:23.507213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:23.514790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c4364f52-adb0-4dbd-b27b-4ac6a413b469 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.160676 Aug 08 17:07:23.515359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 405/819] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:23.577020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:23.579161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:23.586305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.586795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.587231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.587934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:23.588387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:23.589091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:23.619791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3ddcf481-18c7-4fcb-85a2-76d5eb5b067d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Aug 08 17:07:23.620331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 415/820] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:24.458075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:24.460948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:24.469725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.470576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.471557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.472301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.472762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.473181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.504668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-61950f7e-eeed-4edc-aa61-4cf53d0a7171 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052895 Aug 08 17:07:24.505389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 406/821] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:24.537245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:24.538132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:24.544662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.545118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.545550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.546295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.546741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.547172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.635708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:24.639241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:24.646100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.646590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.647036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.647738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:24.648189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:24.648615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:24.690765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4895a58-fce2-4b4f-b24e-e136a05b067b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062095 Aug 08 17:07:24.691340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 407/822] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:24.696767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:24.706048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd9aa14c-ec54-4f15-97e1-acb817c5c72b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.173141 Aug 08 17:07:24.706626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 416/823] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:25.518890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:25.521103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:25.527504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.527990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.528426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.529111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.529564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.530015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.559990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-47738bc3-3a88-433e-a884-51d2828fc2bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045009 Aug 08 17:07:25.560542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 408/824] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:25.703007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:25.705137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:25.711621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.712105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.712541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.713221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.713668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.714112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.727448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:25.728068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:25.734010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.734495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.734931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.735619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:25.736075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:25.736563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:25.745513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2bcda665-3a44-4e6f-97f7-200e69f49381 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Aug 08 17:07:25.746118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 417/825] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:25.874270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:25.881563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f6c4ea7-dd69-4de2-b9f5-6c780962ff47 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158047 Aug 08 17:07:25.882036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 409/826] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:07:26.572753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:26.574854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:26.581280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.581760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.582230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.583584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.584039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.584461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.614056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39cef133-b516-402b-a0c4-3a4b2a83b6af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045213 Aug 08 17:07:26.614506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 418/827] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:26.758356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:26.760481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:26.767239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.767489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.767900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.768588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.769034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.769453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.799331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d75dcbb0-1fd1-477d-b553-af2cd485b9e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Aug 08 17:07:26.799887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 410/828] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:26.902825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:26.903454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:26.909808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.910297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.910735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.911446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:26.911902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:26.912327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:26.927454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:27.054876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:27.062240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4b39d613-59a3-4cfa-9ec1-d4d6f1b074ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.163240 Aug 08 17:07:27.062799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 419/829] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:27.626610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:27.628750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:27.634735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:27.635219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:27.635662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:27.636360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:27.636816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:27.637238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:27.662379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:27.667091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-976e12ad-d4b4-462f-bb09-f14916c69e88 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Aug 08 17:07:27.667657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 411/830] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:27.810775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:27.812996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:27.819864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:27.820410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:27.820892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:27.821685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:27.822215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:27.822740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:27.851945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4cae68b3-2e36-4375-9556-459f1b4a20aa tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Aug 08 17:07:27.852413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 420/831] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:28.084090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:28.084700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:28.091284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.091774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.092198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.092880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.093333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.093751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.240511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:28.248119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-be171ee1-facc-4971-ba61-d74be25de0f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.168265 Aug 08 17:07:28.248683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 412/832] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:28.679398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:28.681599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:28.688205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.688688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.689126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.689851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.690312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.690744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.721435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9feaf49d-8756-46a0-8688-59de297af250 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045948 Aug 08 17:07:28.722070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 421/833] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:28.863850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:28.865896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:28.872264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.872728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.873164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.873879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:28.874360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:28.874781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:28.904733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75bb20cc-ecbd-4291-87bf-a28917115a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Aug 08 17:07:28.905288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 413/834] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:29.269695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:29.270371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:29.277307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.277876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.278345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.279093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.279556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.279986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.420139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:29.428333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-15b6114b-f682-40ef-bf23-77ce67999638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.162561 Aug 08 17:07:29.428898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 422/835] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:29.735189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:29.737409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:29.744706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.745195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.745629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.746357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.746806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.747225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.777991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3fcfe7c3-8561-4514-9380-18cffc8496b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046854 Aug 08 17:07:29.778560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 414/836] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:29.917648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:29.919849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:29.927233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.927710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.928158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.928859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:29.929315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:29.929741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:29.960207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7b7ec942-22b2-4230-9cb9-b9983e43224e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046605 Aug 08 17:07:29.960781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 423/837] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:30.449612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:30.450290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:30.456353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.456838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.457270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:30.458649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.459102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.459524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:30.597066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:30.605305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ebd327db-ad45-45e5-b477-5834ddda693c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.159558 Aug 08 17:07:30.605749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 415/838] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:30.790410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:30.792543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:30.798597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.799085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.799558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:30.800246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.800702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.801129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:30.837213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-91ae3088-fc1f-4fd8-ae93-3b7a0a729718 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050965 Aug 08 17:07:30.838249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 424/839] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:30.972849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:30.975055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:30.981619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.982138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.982576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:30.983272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:30.983752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:30.984176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:31.014985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-260b33f2-218f-4126-8ac9-43cc3d14cb78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046163 Aug 08 17:07:31.015544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 416/840] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:31.627369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:31.627922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:31.634794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:31.634952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:31.635317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:31.636048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:31.636500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:31.636927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:31.773312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:31.781129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-22f899a3-57f3-488a-a1d9-97dc879f7c68 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157668 Aug 08 17:07:31.781728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 425/841] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:31.851811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:31.854051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:31.860032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:31.860511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:31.860941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:31.861627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:31.862099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:31.862517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:31.897051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d8a3d29-983d-4da8-a118-5617cb3f2063 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048604 Aug 08 17:07:31.897924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 417/842] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:32.028025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:32.030359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:32.036375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.036871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.037321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.038307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.039742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.039742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.069564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f93dfdf-6fd7-4037-ba58-55db35a4817e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 08 17:07:32.070153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 426/843] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:32.803832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:32.804429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:32.810792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.811272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.811709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.812387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.812837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.813255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.908837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:32.911315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:32.918837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.919328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.919773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.920482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:32.921072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:32.921504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:32.950991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:32.951742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b236178-9832-42b2-b021-db2818c170a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047033 Aug 08 17:07:32.952332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 427/844] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:32.958733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e360299c-d605-48ec-ae12-49832b60f9d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.159267 Aug 08 17:07:32.959288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 418/845] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:33.082082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:33.084096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:33.090200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.090684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.091123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:33.091813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.092265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.092683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:33.122781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0b7c6afc-3dab-40a2-9740-8ccefc55d76b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Aug 08 17:07:33.123378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 428/846] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:33.964776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:33.966930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:33.973462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.973982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.974421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:33.975293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.975744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.976162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:33.979371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:33.980013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:33.986339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.986821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.987256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:33.987944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:33.988399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:33.988817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:34.005386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64624fd3-3eac-47e3-b43d-5beb4d3c31d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Aug 08 17:07:34.005886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 419/847] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:34.130400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:34.136061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:34.138299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:34.139782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9cd0df46-9f38-4809-86ba-ef669cc205e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.164058 Aug 08 17:07:34.140580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 429/848] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:34.158379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:34.158935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:34.159375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:34.160108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:34.160569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:34.160997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:34.193223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09b27232-4fd8-427d-8cc2-315fa4c8874c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061896 Aug 08 17:07:34.194090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 420/849] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:35.018223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:35.020351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:35.027987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.028467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.028902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.029590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.030074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.030496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.059105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-691613ab-c4f6-4831-aecb-eadab9c6dc92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044905 Aug 08 17:07:35.059652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 430/850] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:35.160792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:35.161544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:35.168775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.169270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.169713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.170447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.170907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.171333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.205845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:35.208056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:35.214995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.215489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.215928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.216625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:35.217076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:35.217531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:35.248095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bfaed94b-071b-4c33-b22b-598f9fec4169 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046200 Aug 08 17:07:35.254923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 431/851] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:35.305462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:35.313024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-06be3668-7eb2-4185-9bad-44a45997e595 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156265 Aug 08 17:07:35.313588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 421/852] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:36.071663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:36.074005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:36.080358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.080843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.081278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.081992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.082443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.082862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.112141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-148f0657-d761-4601-aa7c-5c49eeb3b144 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044454 Aug 08 17:07:36.112690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 432/853] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:36.260378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:36.262537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:36.268979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.269465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.269926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.270669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.271123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.271547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.301402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aed16ea0-9c2e-489d-8b23-91b53897c16e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Aug 08 17:07:36.301986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 422/854] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:36.334433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:36.334974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:36.341344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.341844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.342282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.342961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:36.343489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:36.343829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:36.478257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:36.485871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b6b5993-9186-4678-a008-3efc5aaa740a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155241 Aug 08 17:07:36.486439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 433/855] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:37.124632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:37.126833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:37.132787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.133270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.133702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.135290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.135751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.136185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.164968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-acef2f90-6d5d-41ab-b18a-544ffe78eeca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044321 Aug 08 17:07:37.166283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 423/856] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:37.313239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:37.315532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:37.322610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.323115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.323548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.324238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.324692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.325115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.353764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-16c262d0-abaa-4cf0-9a94-fecf6fc068d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Aug 08 17:07:37.354335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 434/857] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:37.506939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:37.507566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:37.514080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.514565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.515047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.515733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:37.516181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:37.516600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:37.650895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:37.658611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b687ce14-0b2f-4bf5-a129-e35f31c7ed31 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155575 Aug 08 17:07:37.659176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 424/858] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:38.176718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:38.179068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:38.180995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=78 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:38.185768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.186297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.186738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.187450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.187904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.188334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.220169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1c959a27-d1ae-47be-95da-8655c0b3f2c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047455 Aug 08 17:07:38.220726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 435/859] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:38.366124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:38.368261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:38.374247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.374733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.375178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.375863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.376319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.376771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.406358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5a8ec3be-c9f2-48f9-983d-105e22f844bf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 08 17:07:38.406923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 425/860] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:38.680548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:38.681150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:38.688508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.688988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.689427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.690141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:38.690598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:38.691019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:38.693537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:38.822718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:38.830209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5bb44ec8-6cf8-4612-9c24-fc232e916717 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153531 Aug 08 17:07:38.830778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 436/861] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:39.232512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:39.234671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:39.241626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.242146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.242578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:39.243474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.244448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.244867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:39.274856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7198466c-bcd7-49a6-9e16-6134064ae7a1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046536 Aug 08 17:07:39.275943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 426/862] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:39.419689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:39.421869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:39.428094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.428588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.429026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:39.429721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.430212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.430643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:39.460783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a607570b-1563-4b3b-b75a-66e250f94905 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Aug 08 17:07:39.461349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 437/863] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:39.850868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:39.851485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:39.858241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.858739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.859177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:39.859879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:39.860341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:39.860763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.013462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:40.014146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "name": "network-vif-unplugged", "status": "completed", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:07:40.021699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b67c6ea-c270-4fb3-a5bb-1d575643a8ba tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.174615 Aug 08 17:07:40.022315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 427/864] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:40.023583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:40.024098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:40.024509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.044869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] Creating event network-vif-unplugged:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:07:40.050152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-9e23257f-9cc7-420c-ac2d-4d8af712ab1f req-916c3777-ec6f-4eec-a39e-d273edadc37a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097202 Aug 08 17:07:40.055729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 438/865] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:40.288088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:40.290366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:40.293342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=76 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:40.298001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:40.298487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:40.298926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.299618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:40.300070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:40.300495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.316864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:40.330325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-437fa292-9d64-490f-b503-6bcd5dff2ec2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046451 Aug 08 17:07:40.334387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 428/866] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:40.473770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:40.476128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:40.482509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:40.483000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:40.483447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.484133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:40.484593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:40.485021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:40.514693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e9f0669d-c85d-4095-b4b0-c10088c2da7f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Aug 08 17:07:40.516257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 439/867] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:41.045144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:41.045763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:41.051851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.052330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.052789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.053467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.053946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.054372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.187221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:41.194904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6d4e159a-8aa1-4db9-a713-08b7408393f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153986 Aug 08 17:07:41.195475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 429/868] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:41.342988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:41.345067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:41.351440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.351930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.352375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.353151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.353611 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.354065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.391432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b53825c-4d5b-4098-a90f-9c791e1015d7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052524 Aug 08 17:07:41.391990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 440/869] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:41.528089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:41.530311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:41.536821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.537298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.538022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.538699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:41.539147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:41.539592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:41.570299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-52c510e7-f5f8-4529-8b1c-06c17b08b437 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Aug 08 17:07:41.570842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 430/870] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:42.216873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:42.217500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:42.223448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.223932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.224368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.225059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.225517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.225976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.358708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:42.366111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-57895764-114f-411c-840f-2474b721300a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153682 Aug 08 17:07:42.366675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 441/871] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:42.403439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:42.405599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:42.411604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.412087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.412778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.413461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.413942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.414369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.442698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-858df871-13ac-4ddf-8e41-04eb336a5343 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043196 Aug 08 17:07:42.443242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 431/872] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:42.582887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:42.585063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:42.591297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.591822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.592263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.592969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:42.593429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:42.593881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:42.624054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b4e3db0b-ace8-498a-b171-713f010d1c37 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Aug 08 17:07:42.624609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 442/873] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:43.388254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:43.388895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:43.395272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.395756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.396196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.396882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.397340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.397762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.455139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:43.457329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:43.465544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.466063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.466502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.467210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.467663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.468086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.497389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7503ea1-dae4-4a59-8da2-a63710c20acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046218 Aug 08 17:07:43.498248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 443/874] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:43.530447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:43.538075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad3f1f57-bcd9-4399-95ba-d91148209c6b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154182 Aug 08 17:07:43.538634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 432/875] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:43.635912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:43.638065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:43.644027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.644453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.644890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.645580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:43.646067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:43.646519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:43.675368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8543af1e-d550-4dda-84dd-bf45e2af89e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 08 17:07:43.675913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 444/876] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:44.509975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:44.512806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:44.519246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.519725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.520160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.520845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.521295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.521714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.550043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00853d20-6745-4f83-8a9c-16ffd34468f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044198 Aug 08 17:07:44.550592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 433/877] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:44.559449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:44.560067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:44.566412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.566890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.567330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.568038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.568498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.568925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.687881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:44.690320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:44.696145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.696720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.697263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.698524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:44.698982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:44.699401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:44.699643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:44.707538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ed8329bb-3b05-4ba7-82d6-b4d523b78d97 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152470 Aug 08 17:07:44.708116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 445/878] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:44.728505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bef136e0-e8b9-45eb-aa93-b1466edaba9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Aug 08 17:07:44.729178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 434/879] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:45.562420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:45.564559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:45.570684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.571172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.571613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.572303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.572760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.573185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.602240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d94cb884-99d1-4363-8caa-36451d72c060 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043740 Aug 08 17:07:45.602804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 446/880] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:45.728101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:45.728711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:45.735103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.735587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.736020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.736712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.737167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.737592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.740326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:45.742499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:45.748269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.748750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.749186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.749898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:45.750354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:45.750776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:45.781456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b79b5e71-8e90-4698-b7f2-ccc47547d6c7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Aug 08 17:07:45.782063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 447/881] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:45.867428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:45.874842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb0bebf7-a1c8-4cd4-9efc-5ffe5fbce4ad tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150802 Aug 08 17:07:45.875424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 435/882] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:46.615603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:46.617747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:46.625044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.625541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.626019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:46.626732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.627186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.627613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:46.655844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cfa21573-253d-4002-9dac-d57fd81cb954 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Aug 08 17:07:46.656397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 448/883] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:46.794586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:46.796725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:46.802754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.803236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.803667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:46.804344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.804792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.805210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:46.834141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f733c6c-2c27-4d41-8cc6-49bc1447ad78 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Aug 08 17:07:46.834677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 436/884] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:46.894881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:46.895491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:46.901896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.902379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.902813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:46.903496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:46.903946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:46.904369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:47.031539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:47.039179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6dd6f0e1-8659-42fa-90cd-4ebd04aa2e1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.148058 Aug 08 17:07:47.039737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 449/885] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:47.670611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:47.672738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:47.678725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:47.679211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:47.679647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:47.680335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:47.680788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:47.681214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:47.710377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-341cb7e4-cfa6-460a-b2d8-ecbdcc613c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045847 Aug 08 17:07:47.710931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 437/886] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:47.846816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:47.848933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:47.855910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:47.856390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:47.856829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:47.857511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:47.857995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:47.858423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:47.887216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2c2edcb-0d9a-4a8b-bfb9-b363b36c7337 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 08 17:07:47.887757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 450/887] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:48.062763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:48.063365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:48.069735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.070251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.070684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.071377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.071821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.072239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.204787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:48.212343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2785f6ad-4e14-450b-9087-756632cc5d71 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153426 Aug 08 17:07:48.213005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 438/888] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:07:48.722716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:48.724867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:48.730908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.731383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.731814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.732492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.732939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.733358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.761432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0f36e764-e38a-4ed7-95cd-85d432cc3ab9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042679 Aug 08 17:07:48.762002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 451/889] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:48.899553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:48.902299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:48.908223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.908704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.909138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.909880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:48.910332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:48.910752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:48.938662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-477cd983-a36e-4f21-aa02-1ec41a35c9ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Aug 08 17:07:48.939207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 439/890] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:49.233929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:49.234569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:49.240920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.241400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.241864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.242559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.243020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.243447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.374839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:49.382218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11083119-f207-4767-ac48-4a6cb7291ac4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152241 Aug 08 17:07:49.382776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 452/891] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:49.773852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:49.776517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:49.782936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.783423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.783865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.784555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.785016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.785451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.814673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7cb8c837-19ea-4672-8c47-17caefd19358 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Aug 08 17:07:49.815218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 440/892] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:49.951080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:49.953148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:49.959287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.959771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.960209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.960897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:49.961351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:49.961781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:49.975697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:49.991379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-298dfbdc-943b-4272-9955-bbc9718bc9b7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Aug 08 17:07:49.992138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 453/893] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:50.502276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:50.502890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:50.509170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:50.509643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:50.510183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:50.511512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:50.511987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:50.512404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:50.644437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:50.652212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e335b162-a24a-48d4-b15d-28cf946f7112 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.252082 Aug 08 17:07:50.652788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 441/894] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:50.827696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:50.829891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:50.836210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:50.836691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:50.837126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:50.837825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:50.838278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:50.838700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:50.866739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-15b9d2a5-7a3d-4867-b848-30059d06e028 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044044 Aug 08 17:07:50.867280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 454/895] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:51.002821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:51.005069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:51.011568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.012038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.012471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.013149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.013595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.014040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.042684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8c75d09-0f50-4902-8298-889160a35bc6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Aug 08 17:07:51.043224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 442/896] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:51.673291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:51.673994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:51.680003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.680491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.680932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.681623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.682106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.682536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.810359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:51.817825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-46efdeb5-e3c5-428e-b8b5-980c6b909747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.148310 Aug 08 17:07:51.818395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 455/897] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:51.879555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:51.881710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:51.887601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.888077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.888505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.889179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:51.889625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:51.890064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:51.919228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-29dd92a2-1762-47a5-89ab-1d01e61285c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043666 Aug 08 17:07:51.919783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 443/898] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:52.054822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:52.056960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:52.063296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.063782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.064212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.064895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.065344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.065760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.096250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-115871c7-78d0-4b47-b61c-be6e2e70169e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Aug 08 17:07:52.096798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 456/899] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:52.838407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:52.838935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:52.845415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.846011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.846454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.847146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.847603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.848028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.931921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:52.934319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:52.940496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.940979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.941413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.942133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:52.942584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:52.943001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:52.972530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c087fd33-9253-4deb-9df2-6923b8c783dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Aug 08 17:07:52.973100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 457/900] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:07:52.984932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:52.992480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-353362e1-f068-4906-9ea3-3f0dea3fba20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157972 Aug 08 17:07:52.993048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 444/901] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:53.109211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:53.111346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:53.117828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:53.118325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:53.118772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:53.119474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:53.120483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:53.120915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:53.149922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7155f3c9-8e5e-479a-8e8a-89041d9d4a87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 08 17:07:53.150481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 458/902] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:53.984935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:53.987161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:53.993570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:53.994096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:53.994537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:53.995235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:53.995689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:53.996114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:53.999855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:07:54.014849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:54.016861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:54.021427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:54.021942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:54.022375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:54.023125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:54.023577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:54.024277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:54.028340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ae124d2-8b6c-4cbc-b37a-9cdacc8883fe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047286 Aug 08 17:07:54.030190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 445/903] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:54.157030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:54.162942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:54.164929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-71173ba1-b661-4dac-b6f1-8b34bc2b8331 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154798 Aug 08 17:07:54.165059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:54.165498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 459/904] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:07:54.171685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:54.172170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:54.172607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:54.173302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:54.173761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:54.174210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:54.203289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f6a1f394-d694-42cf-8b79-9b089f81e60c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 08 17:07:54.203888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 446/905] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:55.040927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:55.043727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:55.049700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.050226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.050667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.051361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.051821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.052248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.080285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-faa11190-646f-47ff-8303-1d6155c6cec4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043575 Aug 08 17:07:55.080839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 460/906] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:55.185203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:55.185831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:55.192225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.192706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.193140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.193856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.194313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.194736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.216730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:55.219051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:55.225401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.225919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.226361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.227052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:55.227504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:55.227925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:55.257906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5b4f340d-25e9-487a-830d-9e0b9c603aa5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Aug 08 17:07:55.258469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 461/907] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:07:55.328106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:55.335692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4fc0d4d4-7ef3-41af-8ead-b3ac409d8a6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154517 Aug 08 17:07:55.336260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 447/908] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:56.092794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:56.095001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:56.100967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.101452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.101924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.102615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.103072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.103528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.133089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e454fa21-90fd-47d8-8d32-aa209011b946 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044295 Aug 08 17:07:56.133641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 462/909] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:56.269555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:56.271796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:56.278502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.278982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.279415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.280105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.280557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.280981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.310528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ba7ff3ac-fea7-4a7a-b3b0-5c47e9784b02 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Aug 08 17:07:56.311084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 448/910] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:56.357716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:56.358261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:56.364636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.365111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.365543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.366263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:56.366731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:56.367134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:56.497341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:56.504920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4f16e64d-502f-48fa-9ec9-e6d9f61f0538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151601 Aug 08 17:07:56.505476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 463/911] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:57.146131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:57.148255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:57.154718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.155203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.155694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.156553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.157071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.157493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.189948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b78a755c-50f0-47df-a3d2-b84bec411f3b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048297 Aug 08 17:07:57.190501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 449/912] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:57.322924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:57.325088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:57.331117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.331608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.332053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.332748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.333208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.333640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.364099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2583c96-0b71-4a72-b6b4-a9b380bdc9a5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 08 17:07:57.364772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 464/913] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:57.527802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:57.528403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:57.536770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.537509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.537966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.538675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:57.539113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:57.539529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:57.673864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:57.681492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db6b48a6-a293-4c91-8cb1-5e255f079817 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158071 Aug 08 17:07:57.682103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 450/914] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:58.204758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:58.206934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:58.212887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.213367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.213817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.214546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.215006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.215428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.243879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b2ae406f-dd26-47fe-84b7-bc6b6118040c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043056 Aug 08 17:07:58.244434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 465/915] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:58.376513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:58.378794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:58.385044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.385531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.386050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.386804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.387267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.387692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.418093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-620691ac-bc24-46b1-ad99-45177506ba9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 08 17:07:58.418675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 451/916] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:58.704080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:58.704699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:58.711084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.711569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.712007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.712699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:58.713157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:58.713583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:58.846038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:07:58.853568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5dcb7a13-716d-47c7-b4d8-f577def8cea1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153377 Aug 08 17:07:58.854164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 466/917] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:59.256773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:59.258989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:59.266564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.267050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.267483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:59.268178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.268629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.269050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:59.299330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cdbf5f68-d258-4bc3-96fe-19d28a07ff00 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046520 Aug 08 17:07:59.299880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 452/918] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:07:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:07:59.430738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:59.432924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:59.439409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.439887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.440321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:59.441005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.441453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.441897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:59.471887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1c13fe5-188d-4070-8131-628b48536208 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Aug 08 17:07:59.472460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 467/919] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:07:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:59.875001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:07:59.875609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:07:59.881511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.882289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.882727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:59.883407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:59.883858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:59.884277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:00.015627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:00.023372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27b9e40b-7e97-4174-ac61-da10e41ee4ef tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152883 Aug 08 17:08:00.024000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 453/920] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:07:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:00.312418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:00.314586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:00.321165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:00.321648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:00.322158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:00.322810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:00.323262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:00.323686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:00.352491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c574904a-9ca8-465e-9c01-ef7653624903 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044580 Aug 08 17:08:00.353050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 468/921] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:00.487137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:00.489292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:00.496003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:00.497010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:00.497450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:00.498167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:00.498623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:00.499047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:00.529012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa5e4c1e-8094-4cab-9915-5cebebc78e9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045731 Aug 08 17:08:00.529587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 454/922] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:00 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:01.044742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:01.045351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:01.051322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.051835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.052273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.052954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.053414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.053865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.187502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:01.194988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c9a4f452-7707-4c9f-a7df-0bf752d45f29 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154202 Aug 08 17:08:01.195544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 469/923] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:01.366917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:01.369088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:01.376037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.376531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.376966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.377662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.378171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.378628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.408259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-208e98fc-ff7d-4aa9-a305-c8ecf49440db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046973 Aug 08 17:08:01.408818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 455/924] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:01.540982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:01.543644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:01.550024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.550510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.550952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.551645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:01.552102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:01.552526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:01.554879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:01.583109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d76ee2f0-3849-46d8-9d74-aa82709dbd9d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Aug 08 17:08:01.583668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 470/925] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:02.216887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:02.217583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:02.223886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.224367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.224797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.225479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.225958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.226379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.359095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:02.366633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2f94b5e8-65c0-4595-94b9-cfa6075a317d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154187 Aug 08 17:08:02.367127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 456/926] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:02.421524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:02.423732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:02.429907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.430398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.430838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.431527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.431982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.432405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.464375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3522497b-7825-48f9-9945-0002dbe11fae tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047591 Aug 08 17:08:02.464981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 471/927] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:02.596135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:02.598284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:02.604323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.604801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.605235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.605963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:02.606461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:02.611936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:02.635770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2872d737-f971-4bb8-8026-fa7c6cc9a7f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Aug 08 17:08:02.636248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 457/928] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:03.388260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:03.388888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:03.395363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.395847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.396287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.396976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.397433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.397891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.476750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:03.478908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:03.486484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.486972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.487399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.488096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.488541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.488965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.520832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f924924-77b0-4eb5-8763-3714445f82d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048037 Aug 08 17:08:03.521613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 458/929] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:08:03.532244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:03.540006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-721211cb-b7ea-4b2c-8751-06279fefe82a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156184 Aug 08 17:08:03.540532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 472/930] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:03.649053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:03.651124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:03.657735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.658250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.658687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.659364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:03.659810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:03.660226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:03.688502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4cf1b8ca-efe8-4ceb-b0d5-7f4f87e80a46 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Aug 08 17:08:03.689040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 459/931] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:04.533302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:04.535403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:04.542057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.542535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.542970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.544145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.544603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.545023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.560456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:04.561079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:04.568354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.568839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.569270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.569988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.570440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.570859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.574328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-050036fb-7465-4de1-b890-169432a650fa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Aug 08 17:08:04.575628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 473/932] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:04.700705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:04.702934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:04.707871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:04.708863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.709381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.709834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.710521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:04.710977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:04.711404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:04.715823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15279fcc-6261-4cc3-834c-62d8fc1d06e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158709 Aug 08 17:08:04.716383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 460/933] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:04.741357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e646a7db-da01-41c6-8919-fc4d628e7fd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Aug 08 17:08:04.741937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 474/934] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:05.586840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:05.589400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:05.596670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.597158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.597587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.598393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.598840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.599257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.624628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:05.629041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27e02b37-8dc2-42d9-adeb-c6aa0cd2c2be tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046242 Aug 08 17:08:05.629594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 461/935] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:05.737524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:05.738141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:05.744775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.745255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.745689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.746418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.746875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.747287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.752573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:05.754747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:05.761041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.761531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.762155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.762858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:05.763808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:05.764260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:05.794503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eee4227b-20b0-46c7-8ce3-e18a28d63ab7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Aug 08 17:08:05.795547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 462/936] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:05.881702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:05.889147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-001bd725-aaac-4299-9809-d884344a584e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155504 Aug 08 17:08:05.889704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 475/937] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:06.642016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:06.644190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:06.650750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.651235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.651677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:06.652373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.652829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.653246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:06.683149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f073269-cb8d-4600-ba2f-075358611b11 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045639 Aug 08 17:08:06.683703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 463/938] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:06.807225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:06.809441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:06.817814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.818352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.818789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:06.819470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.819930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.820333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:06.849578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ed775bd1-4153-4567-9445-12783f2adbe8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Aug 08 17:08:06.850081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 476/939] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:06.910814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:06.911460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:06.918051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.918538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.918979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:06.920270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:06.920743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:06.921174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:07.052505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:07.060112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2ba259ee-ad4b-4258-aa3f-ba5da25727d0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153255 Aug 08 17:08:07.060674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 464/940] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:07.696329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:07.698507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:07.704578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:07.705070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:07.705513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:07.706247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:07.706712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:07.707142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:07.738353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c87ce64f-8d07-427f-b4b4-b8a0f261ec5a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045929 Aug 08 17:08:07.738945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 477/941] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:07.862916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:07.865028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:07.871824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:07.872319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:07.872760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:07.873468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:07.873956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:07.874383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:07.907423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5df50360-98de-4009-93b5-0ea815a8cb49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048620 Aug 08 17:08:07.908009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 465/942] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:07 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:08.080740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:08.081353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:08.087684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.088162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.088596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.089290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.089774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.090217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.296169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:08.303726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8b9a004c-d781-47d3-9e85-99bd694fba7d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.226736 Aug 08 17:08:08.304480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 478/943] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:08.751169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:08.753304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:08.759258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.759743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.760185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.760872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.761325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.761751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.790955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15edec50-9239-4804-8ced-b5627f8ce22a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Aug 08 17:08:08.791501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 466/944] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:08.920731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:08.922896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:08.924747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=88 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:08.929652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.930333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.930706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.931606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:08.932058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:08.932484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:08.962416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-647a91dd-aaf3-4c07-9fb0-fe34507d9096 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046205 Aug 08 17:08:08.962967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 479/945] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:09.328027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:09.328636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:09.335111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.335590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.336025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:09.336831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.337285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.337705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:09.473470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:09.481205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f792047b-1996-4d05-91f1-48d02a46ed6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157035 Aug 08 17:08:09.481819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 467/946] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:09.804382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:09.806679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:09.813002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.813477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.813966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:09.814645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.815094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.815535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:09.846149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2c17eef0-4618-4bd9-9dde-52070ee5a3f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045550 Aug 08 17:08:09.846645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 480/947] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:09.974621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:09.976744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:09.982988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.983480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.983917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:09.984612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:09.985065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:09.985489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:10.021828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2540e40-2c5a-4da4-bde2-bb485a742ee4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051088 Aug 08 17:08:10.022389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 468/948] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:10.502921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:10.503586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:10.509744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:10.510263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:10.510698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:10.511386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:10.511848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:10.512269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:10.652970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:10.661249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dcf3afda-2634-45fb-8c2c-6d3469bb3aa7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.162088 Aug 08 17:08:10.662108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 481/949] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:10.859548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:10.861625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:10.864032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=82 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:10.868616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:10.869093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:10.869574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:10.870287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:10.872004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:10.872004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:10.901416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c8b57da-7ae1-42cc-96dd-2165c5ebec25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Aug 08 17:08:10.901999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 469/950] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:11.033400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:11.035610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:11.042365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.042847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.043279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.043971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.044913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.045332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.079423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8a367475-61b5-460f-a76d-615b25eb18dc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049969 Aug 08 17:08:11.079980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 482/951] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:11.684073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:11.684683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:11.690578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.691057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.691487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.692173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.692624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.693042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.824853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:11.832961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-337e19cb-ea16-4382-bb53-d24ea4be42ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152924 Aug 08 17:08:11.833527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 470/952] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:11.914236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:11.916371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:11.922393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.922874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.923310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.923992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:11.924441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:11.924861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:11.955028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8c59a51f-ed05-4f78-87d4-eb5f7794eb2e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045156 Aug 08 17:08:11.955602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 483/953] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:12.092502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:12.094711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:12.101162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.101639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.102115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:12.102807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.103427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.103848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:12.134129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-139555d4-5892-439c-9a02-4a1057c2773f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Aug 08 17:08:12.134701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 471/954] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:12.854727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:12.855275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:12.861616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.862138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.862583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:12.863274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.863737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.864159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:12.968595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:12.970848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:12.976740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.977269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.977702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:12.978446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:12.978898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:12.979319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:13.001527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:13.009408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-624e0d8f-21e6-4ef4-80bf-b271081bdb54 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158609 Aug 08 17:08:13.010022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 484/955] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:13.010771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-243798fa-8c0b-437a-ad41-74081fb7968a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046667 Aug 08 17:08:13.011467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 472/956] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:08:13.146569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:13.148794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:13.158202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:13.158202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:13.158202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:13.158202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:13.159322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:13.159322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:13.187361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e81f9c40-3756-43cc-b2d1-d3d4e56d05f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Aug 08 17:08:13.187924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 485/957] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:14.023286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:14.025454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:14.031959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.032445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.032881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.033322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:14.034253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.034364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:14.034710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.035132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.043458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.044223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.045356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.046524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.047156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.047747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.067602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51d14e4c-dcd3-4d14-bda8-6e8ac9e9705a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048144 Aug 08 17:08:14.068309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 473/958] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:14.190760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:14.193135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:14.199205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb4c35c4-0cfa-417d-84b3-8805c8b5e4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.171942 Aug 08 17:08:14.199764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 486/959] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:14.200802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:14.202959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:14.208958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.209439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.209905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.210670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:14.211120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:14.211640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:14.241768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-87d6a63e-b3ea-4370-93d8-0e0537078c52 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Aug 08 17:08:14.242354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 474/960] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:15.081060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:15.083256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:15.089976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.090471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.090913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.092236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.092701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.093129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.121845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-982aa611-8153-48e9-98a6-fe7ccf3ea992 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045084 Aug 08 17:08:15.122903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 487/961] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:15.220506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:15.221110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:15.227662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.228139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.228719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.229408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.229889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.230311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.255021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:15.257157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:15.264177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.264665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.265102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.265815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:15.266284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:15.266706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:15.297510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2e04c1eb-fee8-4b78-b78b-eece7ec5395d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 Aug 08 17:08:15.301892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 488/962] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:15.364542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:15.373236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4043d039-0991-4d54-bb2a-94200e7a7fc2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156221 Aug 08 17:08:15.373816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 475/963] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:16.134939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:16.137063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:16.143363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.143847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.144281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.144972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.145421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.145865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.176452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5aa4b3aa-1951-40ea-995e-9dd4abce4aca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045562 Aug 08 17:08:16.176999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 489/964] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:16.310577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:16.312776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:16.318838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.319404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.319829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.320578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.320944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.321369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.354298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a14f23e-2b21-4685-bfd9-1c3a5b5f1078 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Aug 08 17:08:16.355257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 476/965] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:16.395029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:16.395737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:16.402738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.403319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.404518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.405273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:16.405813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:16.406317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:16.539485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:16.547154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d2f4c058-cf78-40ba-9bb3-a77abd7efd03 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155944 Aug 08 17:08:16.547717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 490/966] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:17.189405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:17.191595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:17.197894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.198410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.198850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.199545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.199998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.200420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.229292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28a93304-b471-4075-9684-5d2ca70a57d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Aug 08 17:08:17.229877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 477/967] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:17.366822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:17.368971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:17.376007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.376489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.376929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.377616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.378094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.378512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.407578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7af0021-8ded-4ab7-a21d-704371df2b27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Aug 08 17:08:17.408142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 491/968] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:17.568295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:17.568937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:17.575460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.575948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.576389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.577087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:17.577573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:17.578031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:17.597538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:17.720086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:17.727604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8026166-19cb-45a2-b95e-a0fb4df894ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.163338 Aug 08 17:08:17.728163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 478/969] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:18.242381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:18.244501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:18.250978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.251459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.251894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.252578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.253027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.253445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.282719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0e84956e-629e-4c34-b8b5-ccc955689eaa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044360 Aug 08 17:08:18.283674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 492/970] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:18.420405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:18.422564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:18.428546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.429025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.429457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.430327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.430620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.431041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.460659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a3b40f34-c314-453c-ae6e-e74d3412a3ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Aug 08 17:08:18.461223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 479/971] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:18.749614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:18.750250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:18.756600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.757085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.757523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.758259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:18.758715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:18.759141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:18.890878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:18.898307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c2e1632f-6a95-4d97-bd3f-1cdcf2359200 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153214 Aug 08 17:08:18.898882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 493/972] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:19.296166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:19.298347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:19.304786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.305267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.305698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:19.306421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.306875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.307304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:19.336204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c5b1c85-a235-4efc-9d46-11808ddf8d02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044039 Aug 08 17:08:19.336753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 480/973] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:19.473436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:19.475769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:19.481716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.482225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.482660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:19.483345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.483797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.484219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:19.513373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a1ddd0ce-9c9a-46a0-a222-2340b9ea42d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Aug 08 17:08:19.513987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 494/974] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:19.920112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:19.920632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:19.926735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.927211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.927642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:19.928322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:19.928770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:19.929188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:20.068110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:20.075764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f9b8bdaa-1671-497f-8259-40c9d184cbaf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.159662 Aug 08 17:08:20.076328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 481/975] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:20.349089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:20.351239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:20.358360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:20.358898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:20.359337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:20.360271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:20.360581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:20.360999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:20.390467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4cb8e78a-d983-44a9-89a1-1fcdd2c45e2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045343 Aug 08 17:08:20.391022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 495/976] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:20.526301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:20.528992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:20.535638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:20.536121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:20.536793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:20.537538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:20.538033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:20.538450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:20.568278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6548c8a3-b44e-43e1-8b9f-158b592bd889 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Aug 08 17:08:20.568827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 482/977] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:21.096924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:21.097585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:21.103992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.104473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.104902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.105584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.106067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.106494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.236867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:21.244560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7e5c0ba3-ac97-44e5-ba07-2fe1e1e8072a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151501 Aug 08 17:08:21.245116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 496/978] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:21.403024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:21.405126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:21.411151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.411896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.412331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.413021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.413476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.413933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.442926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c915243-0526-4022-9757-886a35a37ca1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043945 Aug 08 17:08:21.443490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 483/979] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:21.580634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:21.582839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:21.589599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.590117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.590554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.591247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:21.591695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:21.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:21.621715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-342bc3e1-3fb1-4854-84a2-a3d75132553d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Aug 08 17:08:21.622329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 497/980] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:22.266609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:22.267255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:22.273638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.274148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.274585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.275274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.275746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.276153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.411138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:22.419194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2f56a38-2f14-432d-b40b-6c96bcaee14f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157036 Aug 08 17:08:22.419765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 484/981] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:22.455729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:22.457888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:22.464915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.465393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.465847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.467168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.467620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.468042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.497068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c31c6c99-fea4-4820-ab07-4862a760e31e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045225 Aug 08 17:08:22.497626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 498/982] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:22.634073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:22.636127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:22.642760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.643246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.643681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.644422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:22.644877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:22.645303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:22.675390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a693b596-16d6-4599-8ca8-496a8b35aac6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Aug 08 17:08:22.675952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 485/983] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:23.440331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:23.440998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:23.447579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.448057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.448495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.449180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.449635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.450084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.517014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:23.519279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:23.526030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.526398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.526834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.527527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.527975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.528394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.558693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed41949c-6698-4a4f-921a-e2fa30e9d26c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Aug 08 17:08:23.559255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 486/984] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:08:23.583209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:23.590749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-015cd50c-fc2e-4a22-b340-43c4cf331b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154300 Aug 08 17:08:23.591859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 499/985] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:23.687673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:23.689810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:23.695816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.696232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.696663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.697340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:23.697815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:23.698235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:23.726366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d2d0c95-f68b-4d59-aac6-c2cf6480ff82 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Aug 08 17:08:23.727008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 487/986] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:24.571086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:24.573303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:24.580280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.580768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.581213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.581935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.582407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.582838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.612283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:24.612843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0273d01a-531e-4f31-944f-fecbef898e18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Aug 08 17:08:24.613088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:24.613269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 500/987] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:24.619461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.619937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.620367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.621048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.621492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.621939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.738659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:24.740800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:24.746665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.747154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.747605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.748298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:24.748758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:24.749184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:24.750613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:24.758186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ab98f5b-5952-400f-a02a-e23d48223309 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149415 Aug 08 17:08:24.758969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 488/988] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:24.778422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-40d40cc9-4a26-4c03-ad44-f87e7e065ef7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Aug 08 17:08:24.779613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 501/989] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:25.625247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:25.627437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:25.633863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.634339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.634768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.635441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.635887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.636303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.664669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-55bd82db-10dd-486c-851f-afbc645fd408 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044035 Aug 08 17:08:25.665213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 489/990] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:25.781148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:25.781540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:25.788276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.788756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.789195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.789926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.790449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.790916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.791712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:25.793884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:25.800224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.800705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.801139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.801848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:25.802301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:25.802721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:25.831285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2bae7f81-8e98-4703-b9a6-9e03084f073a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Aug 08 17:08:25.831847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 490/991] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:25.920803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:25.928224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-877de4fc-1e63-4bc8-ad72-7f9c9d29788b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151799 Aug 08 17:08:25.928791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 502/992] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:26.677901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:26.680070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:26.687016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.687498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.687938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:26.688622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.689075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.689498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:26.718249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e3cf70dd-74da-4fcb-a3d1-468716a98fd9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Aug 08 17:08:26.718790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 491/993] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:26.843796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:26.845988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:26.853154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.853670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.854138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:26.854837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.855292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.855719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:26.869602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:26.885712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cf319df8-9b90-4e22-8c0b-22e93c512056 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Aug 08 17:08:26.886334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 503/994] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:26.948378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:26.948994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:26.955010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.955494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.955932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:26.956623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:26.957081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:26.957505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:27.091728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:27.099644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-183ee12b-71da-40fa-8860-09c49b88ac08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155076 Aug 08 17:08:27.100131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 492/995] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:27.730005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:27.732144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:27.738501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:27.738981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:27.739455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:27.740093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:27.740546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:27.740966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:27.768835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-16a676ee-f669-4886-90f7-c7a2af1330f1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042868 Aug 08 17:08:27.769374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 504/996] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:27.898065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:27.900166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:27.906697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:27.907180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:27.907619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:27.908302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:27.908763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:27.909183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:27.939636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-231d6f1f-072d-4cac-af87-8f64f7bbca76 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Aug 08 17:08:27.940197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 493/997] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:28.120872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:28.121481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:28.128299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.128773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.129205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.129908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.130361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.130782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.260285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:28.270077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-012d5e76-0a81-4c2a-a419-38e29b74a73a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153076 Aug 08 17:08:28.270660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 505/998] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:28.781601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:28.783753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:28.789966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.790454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.790893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.791585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.792044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.792472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.821402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-52fb2156-d9db-4833-a711-12f782747e71 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Aug 08 17:08:28.821979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 494/999] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:28.951886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:28.953953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:28.959915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.960399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.960842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.961524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:28.962010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:28.962438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:28.991564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07108e0a-ca4e-4f3a-bdc3-2d091d791938 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 08 17:08:28.992108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 506/1000] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:29.291510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:29.292120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:29.298462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:29.298938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:29.299372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:29.300053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:29.300502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:29.300921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:29.304910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:29.431367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:29.439499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38bf055a-f358-4c9d-87c3-82e3630a417d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151972 Aug 08 17:08:29.440070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 495/1001] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:29.835291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:29.837435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:29.843906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:29.844328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:29.844783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:29.845466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:29.845956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:29.846376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:29.875830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-757e8c7d-3c57-43fc-9d9f-3d8ed24638ea tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044538 Aug 08 17:08:29.876414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 507/1002] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:30.004369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:30.006537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:30.012426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.012904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.013336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.014044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.014490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.014906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.042972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41d1e9ee-2a41-44bf-a1d9-4b08f6358b4f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Aug 08 17:08:30.043519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 496/1003] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:30.461274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:30.461917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:30.468275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.471213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.471213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.471213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.471213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.471578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.607256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:30.614850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1d019f61-783b-44a7-b3ef-0e92e23de8c1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157460 Aug 08 17:08:30.615405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 508/1004] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:30.888908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:30.891102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:30.897441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.897966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.898405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.899093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:30.899549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:30.899981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:30.928368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0161849d-ff33-4c39-8e11-9d12d0d89acb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044115 Aug 08 17:08:30.928918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 497/1005] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:31.055114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:31.057966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:31.065017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.065502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.065963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.066714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.067165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.067583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.097774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1ebacb9-a955-4bf1-910f-5c6ccc476914 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Aug 08 17:08:31.098354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 509/1006] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:31.635272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:31.635883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:31.641911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.642390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.642826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.643505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.643954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.644372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.775106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:31.783049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1123f01b-3a3b-423a-b4ac-3a1c91f76533 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151614 Aug 08 17:08:31.783618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 498/1007] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:31.940269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:31.942364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:31.948397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.948876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.949309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.950020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:31.950475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:31.950901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:31.979400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f65a385f-c01f-43ac-a054-f614fc2e95f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043265 Aug 08 17:08:31.979937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 510/1008] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:32.109930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:32.112107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:32.118643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.119301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.119850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.120269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.120728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.121156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.151515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c28ea9d9-9346-4965-b0b8-5436f3d3e215 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Aug 08 17:08:32.152073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 499/1009] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:32.502321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:32.502924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:32.509522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.510153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.510667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.511380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.511844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.512276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.804725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:32.805335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:32.811878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.812350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.812779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.813455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:32.813950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:32.814369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:32.945680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:32.953176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-189b1b96-4fbf-49f3-8bfa-5083428dcdf2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152270 Aug 08 17:08:32.953733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 500/1010] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:32.992545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:32.994955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:33.000851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.001338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.001773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:33.002481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.002937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.003361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:33.032746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4f308bd-9635-47d3-a88b-16a53ec9c25f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Aug 08 17:08:33.033289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 501/1011] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:08:33.164934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:33.167014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:33.173357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.173869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.174305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:33.174991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.175443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.175864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:33.205555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-552e3cfe-9398-44f3-bbb5-bb1b7d4476f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Aug 08 17:08:33.206147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 502/1012] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:33.974197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:33.974843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:33.980885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.981363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.981853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:33.983149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:33.983610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:33.984038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:34.113835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:34.123480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2f649a07-abe1-4458-994d-a7c2d2df1eb9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151314 Aug 08 17:08:34.123480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 503/1013] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:34.127333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:34.129411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:34.135120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:34.135596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:34.136052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:34.136710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:34.137249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:34.137671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:34.167890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3856ecef-df4a-43bf-a993-b60f3d858536 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044072 Aug 08 17:08:34.168538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 504/1014] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:34.218041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:34.220159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:34.227109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:34.227526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:34.227956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:34.228693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:34.229143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:34.229564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:34.258987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-503e9797-d4cb-425f-974c-97274b81d401 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044938 Aug 08 17:08:34.259532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 505/1015] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:35.143646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:35.144295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:35.155892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.156383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.156823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.157518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.158024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.158451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.291431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:35.299407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0010c7b7-5a12-4282-8446-5a3dd6a8b9df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.159740 Aug 08 17:08:35.299969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 506/1016] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:35.304443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:35.306562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:35.312705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.313181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.313613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.314324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.314776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.315194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.343997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92a7e3bc-abbe-451a-bbde-8c7d27cf1d0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043038 Aug 08 17:08:35.344545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 507/1017] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:35.348940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:35.351013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:35.356584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.357063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.357492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.358207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.359288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.359725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.388763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ba36461-1c66-46a1-a773-1fd26ecce08c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043225 Aug 08 17:08:35.389314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 508/1018] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:36.320816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:36.321501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:36.328534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.329015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.329450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.330169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.330624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.331048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.460108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:36.467765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a274a862-d34e-4397-b10c-f5d399442a9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150743 Aug 08 17:08:36.468375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 509/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:36.473210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:36.475333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:36.480832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.481307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.481734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.482437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.482911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.483328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.512422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e184f34e-ff16-40da-ab76-71f12d0efd63 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043039 Aug 08 17:08:36.512969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 510/1020] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:36.517323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:36.519422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:36.524952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.525429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.525896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.526573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:36.527018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:36.527439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:36.551595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:36.555868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27f716e0-8b66-4016-ae1b-00bfec01ed9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Aug 08 17:08:36.556405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 511/1021] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:37.488596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:37.489287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:37.496254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.496761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.497199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.497930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.498392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.498819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.628739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:37.636156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4028225-fc91-4151-b831-e799290fbdb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151438 Aug 08 17:08:37.636715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 512/1022] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:37.641714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:37.643845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:37.649384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.649899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.650337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.651031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.651482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.651909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.680566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-69943c08-3e87-4aa0-be68-a605dc2756f0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042855 Aug 08 17:08:37.681107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 513/1023] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:37.685613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:37.688211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:37.693612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.694134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.694566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.695335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.695782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.696205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.724233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e975437c-2577-425f-9482-6be230e1fcf5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Aug 08 17:08:37.724767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 514/1024] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:38.657689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:38.658329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:38.665023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.665501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.665960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.666644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.667090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.667511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.799711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:38.807503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d1eb1e1-f362-43e6-86dd-f77e899f8689 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153609 Aug 08 17:08:38.808078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 515/1025] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:38.813298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:38.815427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:38.821211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.821730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.822205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.822904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.823357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.823784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.852922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d5fec561-4a23-4534-87c8-eb61f56bdaa8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043781 Aug 08 17:08:38.853403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 516/1026] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:38.857742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:38.860351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:38.865756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.866260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.867189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.867556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.868002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.868420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.896263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64cdb897-e2b7-45a7-a31b-4226a73a049f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041898 Aug 08 17:08:38.896804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 517/1027] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:39.828826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:39.829460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:39.835878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.836347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.836771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.837449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.837923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.838343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.966549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:39.973977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84a08da8-c584-4665-8f64-87a782032c80 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149396 Aug 08 17:08:39.974542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 518/1028] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:39.979210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:39.981349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:39.983050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:39.987786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.988296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.988737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.989520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.990155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.990574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:40.020405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ffe3a4b-add9-416e-9e4a-a76333300aee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044872 Aug 08 17:08:40.020950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 519/1029] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:40.025440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:40.027498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:40.033175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:40.033649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:40.034110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:40.034786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:40.035232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:40.035651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:40.064223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8fc86170-4ab4-4014-b4e2-627bcb8ed672 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Aug 08 17:08:40.064693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 520/1030] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:40.995431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:40.996061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:41.002676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.003163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.003625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.004310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.004771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.005193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.138249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:41.146431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c81ea75c-f0b7-4f07-b176-41240151475f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154817 Aug 08 17:08:41.146995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 521/1031] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:41.151952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:41.154181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:41.160622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.161362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.161824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.162517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.162971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.163393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.191101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6d7b861c-8e64-487c-9f80-622e56c2c8d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043121 Aug 08 17:08:41.191649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 522/1032] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:41.196035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:41.198207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:41.204303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.204786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.205224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.205938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.206391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.206815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.234948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b2f6c380-29ae-4bf6-a05a-fcce28a1954a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042327 Aug 08 17:08:41.235485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 523/1033] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:42.168276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:42.168943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:42.175998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.176487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.176921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.177609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.178094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.178517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.307979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:42.315454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd6e2829-f77d-47e7-8585-6f0e5f9155ac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151032 Aug 08 17:08:42.316010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 524/1034] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:42.320468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:42.322739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:42.328122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.328602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.329036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.329724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.330210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.330633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.360643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3cede74-8819-401e-8536-69fe82901f29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043639 Aug 08 17:08:42.361186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 525/1035] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:42.365564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:42.367643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:42.373049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.373525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.374027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.374711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.375165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.375586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.403001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c2706e48-e92c-4ab4-9d79-a4c8e964d53e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 Aug 08 17:08:42.403549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 526/1036] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:42.507668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=65 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:42.571671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=49 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:43.336325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:43.336936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:43.344092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.344576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.345012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.345704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.346190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.346617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.480120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:43.487493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-638e259e-0fc6-414d-a469-35e1c29ad0bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155055 Aug 08 17:08:43.488062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 527/1037] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:43.492600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:43.494813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:43.500760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.501252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.501694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.502422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.502875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.503302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.520368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:43.533245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9bdd1a0-fc47-4a3c-8b67-d1f00297afbf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044211 Aug 08 17:08:43.539559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 528/1038] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:43.539559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:43.540930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:43.546489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.546965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.547473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.548152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:43.548601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:43.549024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.577541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-878681f7-7cc0-4bcf-a5ac-6786a73a8815 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Aug 08 17:08:43.578128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 529/1039] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:44.510706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:44.511376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:44.518663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.519142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.519571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.520295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.520744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.521161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.651035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:44.658722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f4f0670-83a9-4d2b-9046-3b7fdb205055 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151824 Aug 08 17:08:44.659281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 530/1040] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:44.664061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:44.666207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:44.671716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.672201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.672638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.673319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.673772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.674218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.703375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b14dbe81-ab98-4ff1-beaf-a8a974099de4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043070 Aug 08 17:08:44.703925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 531/1041] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:44.708314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:44.710439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:44.715927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.716416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.716851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.717535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.718023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.718449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.748171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db8aa0c8-5ebb-44e4-ba8c-3f668dd2d580 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Aug 08 17:08:44.748713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 532/1042] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:45.679430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:45.680051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:45.686409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.686891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.687319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.688000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.688453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.688871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.833871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:45.842352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f2450cf-b1e5-4bad-a7ae-828aaf4fe96c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.166559 Aug 08 17:08:45.843314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 533/1043] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:45.847589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:45.849683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:45.855338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.855820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.856254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.856949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.857396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.857836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.885965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-14cc7db9-07c2-40bd-ace6-c25a2743bb65 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041983 Aug 08 17:08:45.886513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 534/1044] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:45.891544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:45.893585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:45.899050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.899527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.899961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.900644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.901094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.901518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.929994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38ae9e09-eba5-4fab-8e4d-35a04423b266 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Aug 08 17:08:45.930544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 535/1045] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:46.863330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:46.863980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:46.870006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:46.876025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:46.876477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:46.877179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:46.877641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:46.878095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.009972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:47.017441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9568ee25-5588-4784-aff1-b343fafed56f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158146 Aug 08 17:08:47.018038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 536/1046] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:47.022538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:47.024762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:47.030407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.030896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.031335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.032031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.032485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.032912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.062340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-623b42cc-5396-4a31-9aeb-fe299527bf84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042653 Aug 08 17:08:47.062884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 537/1047] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:47.067287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:47.069321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:47.074975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.075460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.075899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.076585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.077065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.077495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.105342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a4ef8ba-8483-49f2-9359-c566b8f5426e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Aug 08 17:08:47.105908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 538/1048] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:48.038431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:48.039141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:48.045540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.046053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.046486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.047171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.047624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.048077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.177716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:48.185184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f99aeaa4-4ab2-4f52-acf2-1713cd90973c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150852 Aug 08 17:08:48.185753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 539/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:48.190762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:48.192852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:48.198505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.198992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.199430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.200122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.200574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.200999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.230046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0fd7bb6-d336-49fa-b7c2-417010cae106 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043242 Aug 08 17:08:48.230599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 540/1050] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:48.234987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:48.237034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:48.242581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.243058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.243497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.244186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.244644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.245072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.273659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9fb60625-8701-47d4-a085-5342148eba79 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Aug 08 17:08:48.274232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 541/1051] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:49.207459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:49.208106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:49.214517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.214996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.215426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.216111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.216565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.216991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.349769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:49.357258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18429e3d-2d9f-4ddf-b5ea-4d126727bc26 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153701 Aug 08 17:08:49.357825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 542/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:49.362413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:49.364473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:49.370245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.370720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.371143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.371817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.372263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.372679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.400865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6f5281a-7715-4743-a221-7ab3fb271f9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042014 Aug 08 17:08:49.401423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 543/1053] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:49.406463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:49.408503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:49.414407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.414909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.415328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.416020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.416501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.416927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:49.444378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2afdf2ff-f12d-4bf4-bc61-38f86d7dc1c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Aug 08 17:08:49.444913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 544/1054] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:50.378377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:50.379064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:50.385438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.385958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.386396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.387158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.387609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.388031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.391976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:50.519688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:50.527098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d864ee9-ccd0-451e-8555-4a0a94ff1a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152601 Aug 08 17:08:50.534262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 545/1055] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:50.538617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:50.540798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:50.547787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.548269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.548700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.551779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.554422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.556997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.736025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54b42015-f7c6-4888-a52d-d8f772824318 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207175 Aug 08 17:08:50.736588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 546/1056] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:50.741242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:50.743405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:50.749071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.749544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.750007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.750685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.751129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.751544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.779810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ba790e28-02ef-4998-9cb3-f03d03e9ae15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Aug 08 17:08:50.780945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 547/1057] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:51.549268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:51.549990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:51.556271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.556746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.557174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.557892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.558343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.558762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.687491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:51.695053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11626067-5b2d-4277-89c2-4caf558c556b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149602 Aug 08 17:08:51.695600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 548/1058] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:51.748027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:51.750192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:51.755927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.756405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.756844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.757524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.758072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.758498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.787926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f4e6fbf0-69a1-443d-b16c-84c059ae65e5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043602 Aug 08 17:08:51.788468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 549/1059] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:08:51.793016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:51.795083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:51.800840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.801269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.801708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.802425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.802879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.803307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.832379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e8492dee-b72c-4d72-aec2-8683f2634a91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Aug 08 17:08:51.832913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 550/1060] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:52.715991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:52.716650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:52.723150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.723631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.724146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.724839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.725291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.725713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.858260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:52.866431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-48231d24-f8a2-4112-999c-c8939435e0f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154261 Aug 08 17:08:52.866987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 551/1061] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:52.877992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:52.880095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:52.886021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.886497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.886924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.887609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.888052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.888468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.918459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5423622b-f359-4c15-95b9-c0e18360ccdd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044826 Aug 08 17:08:52.918999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 552/1062] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:52.923342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:52.925358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:52.930844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.931318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.931748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.932419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.932867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.933278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.961392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bea62a3b-a4dd-4f7e-8a7d-0ddaf7844c36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041441 Aug 08 17:08:52.961955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 553/1063] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:53.888949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:53.889575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:53.896396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.896873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.897301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:53.898099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.898547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.898962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:54.027916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:54.036172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b89c7d2-b8f9-4d24-a151-3607a3888bea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151005 Aug 08 17:08:54.036716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 554/1064] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:54.041116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:54.043213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:54.048535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:54.049009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:54.049439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:54.050150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:54.050596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:54.051041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:54.080420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-292b2ba2-c9e5-4341-9889-27e90233fa03 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Aug 08 17:08:54.080956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 555/1065] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:54.085548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:54.087513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:54.093027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:54.093504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:54.094051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:54.094731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:54.095180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:54.095596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:54.123513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7518e9a8-da8b-4daa-94d5-6c51bad90f0f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Aug 08 17:08:54.124555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 556/1066] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:55.057002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:55.057671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:55.064149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.064636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.065082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.065775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.066252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.066679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.201363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:55.207038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de62bef1-513d-418b-ac8b-eeaecdb47d00 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153919 Aug 08 17:08:55.207600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 557/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:55.212310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:55.214972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:55.222848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.223335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.223769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.224465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.224922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.225349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.254764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b48cb7a-cf30-4cfe-90f0-f26add06ff0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046134 Aug 08 17:08:55.255465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 558/1068] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:55.259995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:55.262207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:55.268477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.268968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.269409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.270170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.270628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.271059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.299931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41ee24f3-7158-4e90-84b8-d0463c2e8e7a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Aug 08 17:08:55.300473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 559/1069] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:56.230391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:56.231150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:56.238951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.239434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.239871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.240566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.241020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.241440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.371841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:56.379269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b240a42-c911-425c-ab0f-0ca3588732e7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154128 Aug 08 17:08:56.379823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 560/1070] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:56.384308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:56.386439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:56.392014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.392497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.392931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.393633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.394113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.394539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.420422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:56.425503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-62dc23eb-9591-442a-84ff-2386ed6f0e7b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044725 Aug 08 17:08:56.426089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 561/1071] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:56.430662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:56.432729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:56.438448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.438935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.439373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.440084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:56.440535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:56.440967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:56.469715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-08ccf34f-e1b3-485a-ab6c-da637a53461f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Aug 08 17:08:56.470364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 562/1072] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:57.399946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:57.400623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:57.407512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.407988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.408416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.409095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.409537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.409984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.544893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:57.552397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19520c23-dfb1-4045-bf27-02a38b3813df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156311 Aug 08 17:08:57.552958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 563/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:57.557534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:57.559671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:57.565432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.566093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.566533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.567223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.567674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.568098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.597617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0175aa5a-75b2-41fb-ad7e-f9904fc1aade tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043632 Aug 08 17:08:57.598197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 564/1074] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:57.602837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:57.604927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:57.610583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.611065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.611508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.612189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:57.612638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:57.613056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:57.640540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c4ba1d8-c021-4c1b-ba7c-58c92cc3c0c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Aug 08 17:08:57.641589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 565/1075] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:58.572919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:58.573608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:58.580175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.580659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.581094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.581818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.582274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.582703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.712833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:58.720704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-814bc1f1-9d07-4534-b020-0cc1e4c3b09e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151599 Aug 08 17:08:58.721256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 566/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:58.726082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:58.728098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:58.733704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.734217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.735240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.735953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.736409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.736830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.764641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70e74729-b469-49c3-85af-d03235b2ce5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 Aug 08 17:08:58.765184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 567/1077] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:58.769703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:58.771782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:58.777188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.777668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.778131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.778812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:58.779261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:58.779681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:58.809062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-299187b1-e9da-4b71-94d3-c456d34de0a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Aug 08 17:08:58.809613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 568/1078] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:59.741703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:59.742398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:59.744787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:59.749622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.752508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.752508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.752508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.752508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.752917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.894612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:59.903238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-899c5441-e119-4cd5-9f6a-0e74f0c396a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.165325 Aug 08 17:08:59.904031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 569/1079] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:59.908849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:59.911260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:59.917497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.918042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.918477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.919209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.919658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.920081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.949873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dd4c585a-5383-439e-a6b2-7c4f9437d5ca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044778 Aug 08 17:08:59.951305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 570/1080] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:08:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:08:59.955175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:59.957308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:59.963232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.963708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.964317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.965012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:59.965460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:59.965906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:59.996261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f66d2717-80ff-4d16-8761-1602556e467d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 08 17:08:59.996813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 571/1081] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:08:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:00.933416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:00.934121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:00.941180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:00.941665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:00.942129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:00.942831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:00.943282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:00.943729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:01.084446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:01.092263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-69f63ab8-51f2-46cf-ae92-5fb034ff08b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.162678 Aug 08 17:09:01.092835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 572/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:01.098172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:01.100319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:01.106023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:01.106498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:01.110798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:01.110798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:01.110798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:01.110798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:01.139667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-93ed2641-bb42-4505-9dfb-58eb4db70f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045687 Aug 08 17:09:01.140254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 573/1083] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:01.145971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:01.154376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:01.155517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:01.157889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:01.158366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:01.159827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:01.159827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:01.160061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:01.191449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a3fa07f-877a-4197-ae8b-8e06af6f5b85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050039 Aug 08 17:09:01.191935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 574/1084] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:02.114131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:02.114818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:02.122512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.123025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.123685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.124414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.124879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.125369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.268907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:02.276532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a791c73-644f-4b4d-9699-d8d382c538fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.166437 Aug 08 17:09:02.277102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 575/1085] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:02.282357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:02.284516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:02.293528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.294045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.294484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.295203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.295653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.296072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.325664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1362a4a5-c398-4104-b2e2-8da2a5d36107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047510 Aug 08 17:09:02.326257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 576/1086] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:02.331744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:02.333889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:02.339889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.340373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.340813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.341510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:02.342023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:02.342446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:02.371435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f0baaa53-f270-4da2-99dd-4b002a86a238 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Aug 08 17:09:02.371903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 577/1087] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:03.299222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:03.299922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:03.306384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.306867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.307301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.307988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.308441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.308870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.326760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:03.440709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:03.448258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-048f1fbc-4cb7-4361-ace9-6ffa3bb3df53 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152867 Aug 08 17:09:03.448831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 578/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:03.453841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:03.455951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:03.461499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.462018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.462468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.463161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.463617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.464042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.492568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9aa4fa9f-6e43-460d-9678-3bb3a07d88e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042742 Aug 08 17:09:03.493221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 579/1089] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:03.498058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:03.500172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:03.506028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.506517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.506990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.507678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:03.508132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:03.508555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:03.540560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5f462780-f248-43bb-a448-07430f391374 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Aug 08 17:09:03.541126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 580/1090] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:04.469706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:04.470984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:04.477355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.477850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.478285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.478969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.479414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.479827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.616118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:04.623608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed6b52e1-989a-4192-9cdf-8588243454da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157778 Aug 08 17:09:04.624168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 581/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:04.629134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:04.631262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:04.636775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.637256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.637692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.638406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.638852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.639271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.668145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b453049-bad1-4b57-9530-af03b863b40b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042983 Aug 08 17:09:04.668699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 582/1092] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:04.673047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:04.675137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:04.680485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.680968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.681409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.682123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:04.682574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:04.682996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:04.713554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99b877b4-8b05-4264-8d52-4418f37864a4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 08 17:09:04.714134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 583/1093] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:05.645220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:05.645906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:05.652372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.652848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.653280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.654006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.654458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.654879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.782281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:05.790497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ed993ae-8a63-4a8d-8d2c-0809a6bb101c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149642 Aug 08 17:09:05.791054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 584/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:05.795615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:05.797706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:05.803511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.803995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.804546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.805247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.805684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.806139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.834861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b250c45a-2452-4385-be3f-0c28c21f07db tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042806 Aug 08 17:09:05.835394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 585/1095] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:05.839869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:05.841910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:05.848222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.848704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.849136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.849854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:05.850305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:05.850730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:05.878659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9cd6909d-e9ee-499f-9c05-1af3d8706e4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Aug 08 17:09:05.879212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 586/1096] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:06.811893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:06.812571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:06.819170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:06.819664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:06.820095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:06.820789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:06.821231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:06.821653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:06.961008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:06.968783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bb56923f-ed34-4059-9e35-e5000f0337a1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.160725 Aug 08 17:09:06.969362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 587/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:06.974696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:06.976829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:06.982850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:06.983335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:06.983774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:06.984472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:06.984925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:06.985349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:07.015376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2527ffce-c7b7-474f-895d-530de6d37aa2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044873 Aug 08 17:09:07.015939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 588/1098] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:07.020634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:07.022922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:07.028761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:07.029248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:07.029688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:07.030415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:07.030869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:07.031296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:07.061653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b13f2be6-24fd-4858-90b0-12706fd760ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Aug 08 17:09:07.062247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 589/1099] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:07 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:07.990881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:07.991612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:07.998420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:07.998968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.002679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.002679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:08.002679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.002679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.146430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:08.154530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35cee4d7-0223-4d0e-9a8d-a7df0f441b2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.167440 Aug 08 17:09:08.155256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 590/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:08.159946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:08.162415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:08.168572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:08.169176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.169610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.170348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:08.170794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.171212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.203408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1f7ce6af-72dd-44c1-b9f7-8be877717943 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047264 Aug 08 17:09:08.207900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 591/1101] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:08.208639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:08.210770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:08.216512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:08.216994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.217432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.218148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:08.218604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:08.219021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:08.247692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30b05c50-e291-49ba-ba86-e7cf622f5878 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Aug 08 17:09:08.248242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 592/1102] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:09.176311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:09.177042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:09.183654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.184178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.184620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.185364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.185847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.186318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.320449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:09.328171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-29df568e-d6c2-4346-8993-b1a581c946b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155657 Aug 08 17:09:09.328736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 593/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:09.333895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:09.335990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:09.342077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.342552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.342983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.343661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.344110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.344526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.372660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5310c3fc-6350-45b3-bcfe-6e4567d1b161 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042931 Aug 08 17:09:09.373202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 594/1104] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:09.378080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:09.380439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:09.386411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.386917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.387466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.388161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:09.388643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:09.389065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:09.393307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:09.417970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-210eba42-0289-49c5-884a-11d920707cb1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Aug 08 17:09:09.418509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 595/1105] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:10.350560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:10.351180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:10.358075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.358556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.358987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.359680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.360135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.360555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.498899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:10.507478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b5d1d2fb-021a-475a-8c11-2e674b6d1556 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.160759 Aug 08 17:09:10.508078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 596/1106] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:10.512984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:10.515187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:10.521706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.522310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.522748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.523449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.523902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.524326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.560590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7110d2d-e000-44ab-8b35-8e345f6e73e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051432 Aug 08 17:09:10.561165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 597/1107] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:10.566510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:10.568659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:10.574885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.579500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.579500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.579500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:10.579500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:10.580380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:10.608780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5d4708c6-7901-488f-b361-506c65690a68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Aug 08 17:09:10.609604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 598/1108] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:11.528409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:11.529054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:11.536565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.537038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.537465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.538190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.538634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.539051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.673987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:11.681504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1068a614-0941-462f-a9f1-ae073f792a9e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156922 Aug 08 17:09:11.682089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 599/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:11.686652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:11.688764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:11.694343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.694816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.695245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.695921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.696367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.696784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.725918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63f357d3-6179-4f04-b859-742ca8e152d4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042819 Aug 08 17:09:11.726450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 600/1110] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:11.730783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:11.732803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:11.738189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.738663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.739092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.739763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:11.740212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:11.740718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:11.768363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-295dde7f-ca27-46bb-bab5-edde0a0eb12e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 Aug 08 17:09:11.768893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 601/1111] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:12.702518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:12.703169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:12.709525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.710036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.710477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.711167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.711620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.712042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.840761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:12.848566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ac77756-62af-4c8e-a06c-2aa4372ff0ae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149903 Aug 08 17:09:12.849117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 602/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:12.853946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:12.856026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:12.862622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.863154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.863661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.864447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.864936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.865600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.893587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4050765d-d617-4dcb-9b06-24bc340704e2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043496 Aug 08 17:09:12.894148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 603/1113] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:12.898566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:12.900612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:12.906128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.906604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.907036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.908182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:12.908652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:12.909067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:12.937305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1df383e-0741-4cb6-b708-e98bfb52491c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042218 Aug 08 17:09:12.937851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 604/1114] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:13.869989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:13.870576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:13.877756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:13.878278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:13.878719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:13.879406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:13.879865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:13.880290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:14.010424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:14.017958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77c68655-012f-4300-bcfc-2b1f03f078b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151873 Aug 08 17:09:14.018506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 605/1115] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:14.023775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:14.029470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:14.035320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:14.036048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:14.036476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:14.037154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:14.037982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:14.038127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:14.068163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1a16f89-3e1c-46b7-a357-45a1df5e9312 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048687 Aug 08 17:09:14.068804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 606/1116] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:14.073148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:14.075219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:14.080584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:14.081056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:14.081486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:14.082180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:14.082626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:14.083045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:14.110588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f65a6c15-5075-4bff-ac8e-304118dc79fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Aug 08 17:09:14.111612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 607/1117] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:15.039390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:15.040084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:15.046374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.046858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.047286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.047966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.048438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.048858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.182705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:15.190723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6344e66a-f033-4509-8baa-d68623915a38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155593 Aug 08 17:09:15.191284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 608/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:15.195958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:15.198102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:15.203762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.206840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.206840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.206840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.206840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.207176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.234810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f62d784e-25ac-4e75-a1d9-f39488a05e05 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042506 Aug 08 17:09:15.235355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 609/1119] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:15.240190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:15.242298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:15.248072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.248553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.248996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.249686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:15.250163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:15.252764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:15.283184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0dd464d3-cbc1-47b2-84ce-905191ad7f15 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046744 Aug 08 17:09:15.283737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 610/1120] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:16.212664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:16.213315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:16.219310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.219784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.220262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.220941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.222036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.222459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.351304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:16.354717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:16.358984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42ef8c88-1959-4607-a2bf-3dd36fa098e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150480 Aug 08 17:09:16.359531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 611/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:16.364137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:16.366615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:16.373040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.373040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.373256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.373878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.374329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.374748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.404046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f782e62-4a4c-43a9-9aed-6a4c84b2ca0d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043525 Aug 08 17:09:16.404596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 612/1122] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:16.409690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:16.412070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:16.417613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.418125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.418558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.419232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:16.419700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:16.420095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:16.448568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac86e6af-aaaa-4f7b-a813-920cc76d7f55 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Aug 08 17:09:16.449113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 613/1123] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:17.381255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:17.381954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:17.388171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.388657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.389096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.389820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.390272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.390694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.523173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:17.530770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa8f9eed-88ee-45f7-ab45-1b74c77ce43f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154318 Aug 08 17:09:17.531331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 614/1124] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:17.536170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:17.538421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:17.544225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.544705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.545135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.545835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.546282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.546704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.575611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c54349d2-9b5e-47c7-a32c-6e1ba5d69ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Aug 08 17:09:17.576149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 615/1125] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:17.580494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:17.583251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:17.588873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.589810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.590234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.590924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:17.591369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:17.591790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:17.620697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bfa90fa1-0fd4-445c-9185-f7faf2ace387 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Aug 08 17:09:17.621245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 616/1126] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:18.552249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:18.552938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:18.559593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.560069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.560506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.561197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.561652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.562106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.692103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:18.699599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6ceda6e-acd7-45f1-84d3-bc6e615ae475 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151283 Aug 08 17:09:18.700136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 617/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:18.704576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:18.707184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:18.712621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.713109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.713545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.714252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.714703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.715125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.743245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ebff94b7-928d-47e6-89b4-d7a9ac460e7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042134 Aug 08 17:09:18.743938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 618/1128] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:18.748280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:18.750339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:18.751904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:18.756808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.757284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.757722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.762801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:18.762801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:18.762801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:18.787726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e108425-1cd5-43c8-8438-f7aee2225a0a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Aug 08 17:09:18.788267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 619/1129] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:19.721011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:19.722175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:19.728690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.729162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.729587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.730287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.730742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.731157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.858504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:19.865938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a58d47f1-ca51-447a-b88a-6229b83ed4bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.148752 Aug 08 17:09:19.866489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 620/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:19.870937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:19.873047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:19.878563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.879035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.879463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.880134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.880577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.880993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.909761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fdce31f6-89db-414c-9ee2-8250bd62ca79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041788 Aug 08 17:09:19.910565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 621/1131] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:19.914889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:19.916919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:19.922446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.922901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.923327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.924001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:19.924486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:19.924903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:19.951999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42916eb3-42e2-4f65-9842-1afdcf74c282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040497 Aug 08 17:09:19.952528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 622/1132] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:20.887143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:20.887792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:20.894061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:20.899362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:20.899362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:20.899362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:20.899362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:20.899720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:21.030005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:21.038238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-31415814-2091-4e03-97ba-3ce987d1cf07 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155002 Aug 08 17:09:21.038798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 623/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:21.043537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:21.045745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:21.052184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:21.052665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:21.053110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:21.053807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:21.054284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:21.054706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:21.082687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f1c648ec-0fd0-41bb-9142-2d32b3e34e2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042690 Aug 08 17:09:21.083132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 624/1134] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:21.087718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:21.089814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:21.095431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:21.095910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:21.096361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:21.097546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:21.098026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:21.098448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:21.126709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb6a4ac4-fc90-4769-9cac-45deaf92e5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Aug 08 17:09:21.127247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 625/1135] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:22.059462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:22.060123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:22.067036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.067524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.067962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.068654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.069108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.069533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.201616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:22.209088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-60c07be4-4790-4e23-ad42-4834cc26f765 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153536 Aug 08 17:09:22.209650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 626/1136] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:22.214281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:22.216375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:22.222195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.222680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.223118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.223805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.224255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.224686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.253676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11b0f091-3883-41b5-b08a-0a8c5c00f601 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042428 Aug 08 17:09:22.254384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 627/1137] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:22.258914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:22.260961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:22.266415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.266894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.267331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.268009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:22.268461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:22.268984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:22.284818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:22.297956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc26aa1e-a5d2-4c8d-92d0-d77b5a5a9bf6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 Aug 08 17:09:22.300964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 628/1138] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:23.230559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:23.231220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:23.238506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.238988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.239420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.240108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.240564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.240987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.374847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:23.382274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42f809d1-a5e2-410b-8d28-8aca54bde9c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155862 Aug 08 17:09:23.382826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 629/1139] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:23.387313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:23.389399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:23.395254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.395744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.396180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.397220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.397422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.397865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.427754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6eb6404-a1d0-4889-b5ac-41e4575c33a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043770 Aug 08 17:09:23.428167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 630/1140] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:23.432575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:23.434825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:23.448754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.449754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.449754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.450422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:23.450870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:23.451288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:23.479979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3061c693-2306-42ac-a169-5395fc3f14d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050810 Aug 08 17:09:23.480512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 631/1141] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:24.403360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:24.404053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:24.410741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.411214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.411642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.412327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.412776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.413191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.544819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:24.552912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bf80f237-064c-4593-87ae-a3bdebd0ebb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153407 Aug 08 17:09:24.553469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 632/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:24.557962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:24.560085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:24.566209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.566688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.567126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.567814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.568264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.568687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.596827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-83df19fc-8bca-4b22-8f2d-4e44b3846809 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042316 Aug 08 17:09:24.597374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 633/1143] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:24.601826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:24.603917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:24.609431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.609949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.610385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.611068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:24.611522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:24.611945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:24.641323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0bb1072d-a1a5-45e2-9b4c-4f7aed85a557 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042947 Aug 08 17:09:24.641882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 634/1144] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:25.574463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:25.575138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:25.582078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.582567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.583004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.583704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.584159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.584585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.718991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:25.726515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8de955fe-311f-4917-b293-fb51bcdb8519 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155864 Aug 08 17:09:25.727068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 635/1145] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:25.731539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:25.733622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:25.739741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.740222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.740659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.741378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.741852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.742274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.771302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7541b06-807d-42fc-ad74-14be3251ce99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043262 Aug 08 17:09:25.771839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 636/1146] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:25.776169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:25.778224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:25.783551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.784019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.784476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.785393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:25.785866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:25.786283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:25.813406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c19ba71d-94ce-4024-ad11-e14b5e589aeb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040626 Aug 08 17:09:25.813973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 637/1147] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:26.747814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:26.748489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:26.755147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.755638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.756077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:26.756781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.757233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.757660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:26.918955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:26.926739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-78111868-0790-4358-a01f-9ecc6a2857d7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.182713 Aug 08 17:09:26.927314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 638/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:09:26.933214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:26.935398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:26.942950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.943986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.943986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:26.944594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.945046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.945470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:26.975218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00429ac2-d322-455f-855c-ae34d29efadc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046853 Aug 08 17:09:26.975781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 639/1149] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:26.980357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:26.982518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:26.988642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.989128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.989562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:26.990908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:26.990908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:26.991172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:27.022270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90a0ec6f-1460-47f9-b083-ff755b64098a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Aug 08 17:09:27.022761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 640/1150] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:27.947985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:27.948666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:27.955448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:27.955965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:27.956412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:27.957093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:27.957541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:27.957992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:28.101178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:28.109395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9593bc50-076d-4d5a-a9e5-920f21a43046 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.165221 Aug 08 17:09:28.110056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 641/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:28.115471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:28.118350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:28.125177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:28.125673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:28.126180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:28.126983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:28.127487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:28.128010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:28.159815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e90bcf2a-e552-4575-820c-82aa79abc913 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048110 Aug 08 17:09:28.160652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 642/1152] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:28.165463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:28.167641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:28.173689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:28.174307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:28.181405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:28.181405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:28.181405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:28.181405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:28.207264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f2af29b-ea19-43aa-9f2e-ce4efd9d25e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Aug 08 17:09:28.207845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 643/1153] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:29.131963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:29.132632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:29.139202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.139683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.140121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.140840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.141295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.141726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.279200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:29.288206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c51305d-51cc-4ae8-8981-90d04b5b880c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.160715 Aug 08 17:09:29.289053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 644/1154] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:29.293551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:29.295667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:29.303266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.303832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.304273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.304971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.305412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.305857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.314084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:29.340934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fdbfe87c-bddc-4b96-a410-1c79d91e682d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050860 Aug 08 17:09:29.341491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 645/1155] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:29.346255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:29.348953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:29.354652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.355143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.355631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.356321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:29.356804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:29.357224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:29.387539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-73d880e0-9e69-4928-b1aa-fc981b2fb336 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Aug 08 17:09:29.388091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 646/1156] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:30.310463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:30.311145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:30.318712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.319096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.319529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.320221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.320670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.321091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.454793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:30.462785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4c1d567-9945-4587-a11a-93d779477265 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156107 Aug 08 17:09:30.463355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 647/1157] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:30.467957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:30.470144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:30.476150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.476636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.477078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.477778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.478264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.478693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.510598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2d065dc-4edb-488d-9711-2116faa151c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046160 Aug 08 17:09:30.511163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 648/1158] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:30.515752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:30.517918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:30.523836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.524358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.524802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.525515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:30.526003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:30.526433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:30.557368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8ebfb11b-6496-46f4-a7e1-70f4d1eeb2fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 08 17:09:30.557965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 649/1159] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:31.484211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:31.484887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:31.491410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.492862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.492862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.493069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.493446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.493908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.626598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:09:31.634835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c9a8f23-8093-408f-be73-b15529b984a5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154507 Aug 08 17:09:31.635403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 650/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:09:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:09:31.640056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:31.642218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:31.648731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.649217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.649658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.650375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.650829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.651254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.679582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-50ccfac6-9015-4de7-b550-411a84ba187a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043170 Aug 08 17:09:31.680127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 651/1161] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:09:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:09:31.684650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:31.686767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:31.692959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.693447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.693927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.694628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:31.695088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:31.695514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:31.725104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63fb8b6d-5696-4ad7-bee9-abe9f5277818 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Aug 08 17:09:31.725658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 652/1162] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:09:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:09:32.561092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:09:32.561684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:09:32.567997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:32.568474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:32.568899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:32.569580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:09:32.570061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:09:32.570489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:09:37.062570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:09:37.128034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:09:42.565821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=69 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:47.106221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:09:47.132947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=54 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:21.544276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:10:21.544880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:10:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:10:24.362440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:10:24.362930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:10:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:10:25.403194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:10:25.403780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:10:32.893573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:10:32.896266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:10:32.897895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:10:32.898915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:10:32.901607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:32.903043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:32.904237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) Aug 08 17:10:32.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:10:32.907276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [1464124d-c497-4175-b58f-916c7ad37011] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 17:10:32.907698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4adbca2a-c4b0-481d-91a7-455edce78a5a) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:10:32.907698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fbef46a3-aa34-4bb2-ab24-3f5b5c7f7dff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 60.342452 Aug 08 17:10:32.907698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 653/1163] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:09:32 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 60344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 17:10:32.907698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:32.908242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:32.913540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:32.914067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:32.914502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:32.915203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:32.915658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:32.916084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.046833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:33.055018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc7e0979-8b62-4097-9f20-8636a082dc22 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153811 Aug 08 17:10:33.055572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 654/1164] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:33.060061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:33.062181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:33.067912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.068393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.068822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.069506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.070002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.070427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.098885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-37050d41-670c-492e-8355-f79338e5d192 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042323 Aug 08 17:10:33.099916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 655/1165] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:33.104315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:33.106369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:33.111767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.112235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.112696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.113697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.114169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.114589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.143045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27503385-5834-4ce1-997e-18a448867e0e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 Aug 08 17:10:33.143588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 656/1166] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:33.148118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:33.148609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:33.157143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.157618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.158073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.159004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.159452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.159968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.904226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [1464124d-c497-4175-b58f-916c7ad37011] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51278. Aug 08 17:10:33.907511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6e344b3a-d251-4ada-9402-2ae97b58d3bc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 202 len: 0 microversion: 2.1 time: 121.409836 Aug 08 17:10:33.908099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 511/1167] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:08:32 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 0 bytes in 121411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:10:33.913867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:33.914642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:33.921410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.921931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.922371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:33.923070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:33.923531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:33.923954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:34.065586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:34.073804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bb864164-a370-438d-988a-d5c10ea5454e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.164348 Aug 08 17:10:34.074380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 512/1168] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:34.143790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:34.146072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:34.151958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:34.152474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:34.152902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:34.153590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:34.154067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:34.154490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:34.331210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d3112c29-fca0-4a19-b755-831a87fac8a7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.255780 Aug 08 17:10:34.331914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 513/1169] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:34.336543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:34.338633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:34.344497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:34.344986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:34.345427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:34.346165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:34.346624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:34.347048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:34.377279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-49a5e036-ae07-4c64-9e0c-249f1ac902ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 08 17:10:34.377726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 514/1170] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:35.094863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:35.095576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:35.102694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.103176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.103633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.104303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.104758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.105173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.236025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:35.243856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5e3b3db9-57bd-44ad-b487-873ba17cde6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152837 Aug 08 17:10:35.244410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 515/1171] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:35.343443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:35.345714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:35.352141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.352630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.353076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.353768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.354249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.354680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.385261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-55f5be59-a613-43cd-afe7-dfaa05682d81 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045797 Aug 08 17:10:35.385841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 516/1172] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:10:35.390334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:35.392434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:35.398185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.398677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.399857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.399857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:35.400411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:35.400675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:35.431872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-506c6724-6996-4c17-aefb-655a8051c978 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Aug 08 17:10:35.432438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 517/1173] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:36.264468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:36.265162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:36.271538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.272026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.272471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.273169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.273629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.274092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.402183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:36.410038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-65134b3e-fb57-4e1b-b2a4-fb8221f3a795 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149398 Aug 08 17:10:36.410602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 518/1174] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:36.415244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:36.417346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:36.423662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.424209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.424696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.425436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.426026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.426567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.457949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02c39a89-5a90-4ee0-bbda-3b3257ed3eec tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046292 Aug 08 17:10:36.458502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 519/1175] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:36.462992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:36.465094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:36.470697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.471185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.471629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.472320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:36.472784 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:36.473238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:36.502595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d2a1a917-5290-4360-a436-8b922cc48939 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043063 Aug 08 17:10:36.503166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 520/1176] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:37.431319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:37.432004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:37.438504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.438998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.439444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.440143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.440618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.441049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.575469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:37.582979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-18e03ccc-82d9-4171-9ba7-3143ff085589 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155483 Aug 08 17:10:37.584166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 521/1177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:37.589446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:37.591616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:37.597562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.598078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.598519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.599292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.599750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.600176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.628017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-52f29f05-18ed-4599-b704-ff9f8f100033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042877 Aug 08 17:10:37.628567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 522/1178] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:37.633524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:37.635628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:37.641201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.641678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.642148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.642833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:37.643290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:37.643713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:37.672632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-83c41eaf-cbc7-4432-967f-7f634f1395b1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Aug 08 17:10:37.673174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 523/1179] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:38.605027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:38.605628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:38.611999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.612488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.612920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.613613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.614110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.614537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.745127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:38.753856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dd2999de-416d-4916-867c-6acd846221e9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152563 Aug 08 17:10:38.754453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 524/1180] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:38.760135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:38.762373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:38.768506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.769096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.769442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.770177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.770634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.771564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.801151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-45ff96d2-d32b-4455-a452-4b81a503ca7e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Aug 08 17:10:38.801707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 525/1181] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:38.806318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:38.808420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:38.813995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.814487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.814934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.815622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:38.816125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:38.816524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:38.844906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e246e122-f785-401a-a615-23de63e613cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Aug 08 17:10:38.845379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 526/1182] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:39.775096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:39.775863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:39.782191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.782680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.783114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:39.784072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.784545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.784965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:39.917993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:39.925500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-47e80d49-ae38-463c-a030-449c9cf17ee5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154406 Aug 08 17:10:39.926089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 527/1183] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:39.931271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:39.933397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:39.939109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.939580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.940024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:39.940712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.941167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.941590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:39.945377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:39.970996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-89cc33fb-c40d-4435-bb5e-58e3e0a891d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043878 Aug 08 17:10:39.971561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 528/1184] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:39.976528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:39.978691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:39.984922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.985408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.985874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:39.986563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:39.987021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:39.987537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:40.016703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bbf31f44-4bcb-4770-a31a-6926b3710c85 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Aug 08 17:10:40.017254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 529/1185] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:40.948310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:40.948959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:40.955182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:40.955663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:40.956208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:40.956836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:40.957233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:40.957653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:41.088435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:41.095997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e0ddac7d-328b-46e6-bc7d-e4539b3d1d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151642 Aug 08 17:10:41.096569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 530/1186] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:41.102426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:41.104569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:41.110382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:41.110864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:41.111327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:41.112040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:41.112692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:41.113113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:41.141725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4380adb8-454d-4b5b-8a1f-af1415f4b8a6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044025 Aug 08 17:10:41.142296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 531/1187] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:41.147375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:41.149490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:41.154982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:41.155458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:41.155894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:41.156574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:41.157024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:41.157451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:41.185480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6ad265c5-8dca-4f07-8c30-d9a5bd6d0cbf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Aug 08 17:10:41.186055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 532/1188] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:42.117767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:42.118419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:42.125052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.125536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.126077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.126774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.127228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.127752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.259275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:42.266730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eac50f88-b539-44a2-892d-b6b923328084 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153094 Aug 08 17:10:42.267283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 533/1189] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:42.271850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:42.273980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:42.279820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.280313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.280877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.281581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.282072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.282502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.311485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ce97d8d0-4466-4013-b8a6-12870e199364 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043224 Aug 08 17:10:42.312038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 534/1190] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:42.316716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:42.319544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:42.325089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.325573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.326051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.326735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:42.327210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:42.327619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:42.356591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5e26b2ac-dec7-4be9-8bfd-ab12fbc38d84 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Aug 08 17:10:42.357151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 535/1191] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:43.152035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:43.179896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=22 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:43.287932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:43.288540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:43.294890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.295372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.295803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.296491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.296945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.297366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.435694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:43.444005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3f88749a-96ea-4645-b0ee-99ebcf226570 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.159882 Aug 08 17:10:43.444571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 536/1192] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:43.449305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:43.456605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:43.458196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.458685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.459120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.459818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.460269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.460786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.492861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-83259f60-ca3b-41fe-b1de-a0b568d73392 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047257 Aug 08 17:10:43.493416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 537/1193] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:43.498041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:43.500609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:43.507029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.508011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.508172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.508764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:43.509216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:43.509627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:43.539930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e3916529-e7c8-4f6b-8c81-60ae8db925cf tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Aug 08 17:10:43.540512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 538/1194] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:44.465185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:44.465857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:44.472293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.472776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.473215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.473945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.474407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.474837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.607095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:44.615417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a63d4249-3972-49d8-8b9b-fefae6da7ab4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154175 Aug 08 17:10:44.615982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 539/1195] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:44.620580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:44.622746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:44.628569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.629049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.629484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.630762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.631211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.631631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.661016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e645811d-bf17-4fc6-b9a5-4439f637cb14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044014 Aug 08 17:10:44.661646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 540/1196] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:44.666137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:44.668271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:44.674012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.674503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.674947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.675638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:44.676096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:44.676520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:44.706622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2b5341e-f0ee-4bbb-9d18-e4ab9ccd8422 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Aug 08 17:10:44.707170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 541/1197] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:45.637429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:45.638113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:45.644052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.644531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.644965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.646316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.646776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.647201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.780185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:45.788139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3fd81770-b2d4-4942-9345-33a48802ab2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154967 Aug 08 17:10:45.788700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 542/1198] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:45.793252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:45.795402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:45.801127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.801616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.802087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.802790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.803245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.803672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.832067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b6f88fb9-ffde-4542-87b1-b6da21021a64 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042369 Aug 08 17:10:45.832613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 543/1199] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:45.837662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:45.840112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:45.845596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.846121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.846567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.847256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:45.847717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:45.848160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:45.871973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:45.876340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f690e67b-b00e-4d7e-9e36-b71713fba3d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Aug 08 17:10:45.876891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 544/1200] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:46.808596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:46.809278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:46.816086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:46.816572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:46.817012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:46.817725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:46.818220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:46.818636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:46.947987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:46.955582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8b1b44eb-d888-4184-82b8-4d4b3e912cf0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150878 Aug 08 17:10:46.956305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 545/1201] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:46.961168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:46.963317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:46.968894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:46.969441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:46.969917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:46.970619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:46.971078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:46.971541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:46.999997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bf3dc03c-607c-4f77-bf76-c6faadfd31f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042851 Aug 08 17:10:47.000579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 546/1202] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:47.005000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:47.007118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:47.012648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:47.013132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:47.013573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:47.014293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:47.014750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:47.015179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:47.044010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6b3dfefc-cef2-4b18-aa07-73689f2bc310 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 Aug 08 17:10:47.044557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 547/1203] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:47.977869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:47.978498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:47.984852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:47.985334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:47.985775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:47.986500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:47.986955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:47.987376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:48.120855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:48.130504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87057248-a7a1-4e80-bd4d-78102e55939d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157025 Aug 08 17:10:48.131102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 548/1204] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:48.138122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:48.138638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:48.144610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:48.145100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:48.145546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:48.146321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:48.146785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:48.149320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:48.176547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6b7aef70-f7cd-477a-a991-eeaa7f7f7339 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044389 Aug 08 17:10:48.177726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 549/1205] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:48.182244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:48.184353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:48.190019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:48.190507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:48.190951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:48.191649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:48.192115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:48.192578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:48.220313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-db5179c9-097f-4b9b-b9a3-992caab4d172 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Aug 08 17:10:48.220869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 550/1206] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:49.152158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:49.152846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:49.159458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.159940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.160372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.161233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.162309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.162741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.292362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:49.299960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fdbad1f4-d9d2-4fd0-8f9e-f8b806a1cf6e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151479 Aug 08 17:10:49.300524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 551/1207] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:49.305123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:49.307302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:49.312889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.313367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.313814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.314510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.314958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.315555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.344089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9650df74-a0be-4b32-b65c-2d2036b99059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042578 Aug 08 17:10:49.344631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 552/1208] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:49.349775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:49.351874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:49.357353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.357930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.358376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.359053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:49.359511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:49.359937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:49.388432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1333cb2d-07b9-4386-b4c1-540b182540e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Aug 08 17:10:49.388969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 553/1209] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:50.321241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:50.321933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:50.328355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.328842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.329283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.330016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.330482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.330922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.460888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:50.468561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ea11e806-fc3b-494b-84e0-6278c09b7685 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151205 Aug 08 17:10:50.469234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 554/1210] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:50.474677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:50.476798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:50.482452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.482941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.483377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.484068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.484628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.485057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.514384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9abc7628-750a-49a9-948f-0064cb3f38c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043956 Aug 08 17:10:50.514939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 555/1211] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:50.519525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:50.522216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:50.527956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.528449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.528890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.529591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:50.530073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:50.530501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:50.559838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c97feb02-d5cb-4738-97b0-bb627144b873 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Aug 08 17:10:50.560541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 556/1212] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:51.489294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:51.489984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:51.496382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.496864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.497311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.498037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.498495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.498924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.632492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:51.640089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7f9e64f1-479a-47fe-972a-6a86bfa2680e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154696 Aug 08 17:10:51.640654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 557/1213] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:51.646007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:51.648212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:51.654008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.654500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.654981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.655678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.656139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.656570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.686764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fda72443-6027-454c-96d4-be64f6062dba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044936 Aug 08 17:10:51.687236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 558/1214] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:51.691913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:51.694658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:51.700286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.700779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.701258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.701994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:51.702456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:51.702888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:51.731760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb95cfcf-acc5-4b07-8db0-04d3eb8d4840 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Aug 08 17:10:51.732357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 559/1215] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:52.662604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:52.663259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:52.669989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.670506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.670950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.671655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.672140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.672579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.804528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:52.812196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-49190d01-c9d3-4045-b1ee-f3f61cbfd8ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154515 Aug 08 17:10:52.812769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 560/1216] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:52.817413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:52.819614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:52.822445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:52.825744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.826262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.826709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.827408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.827872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.828405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.853502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:52.865934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-42d0f12a-32af-4510-83b7-97583cbb6938 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052143 Aug 08 17:10:52.866488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 561/1217] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:52.871280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:52.873324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:52.879517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.879989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.880422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.881106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:52.881561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:52.882022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:52.910752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5e1d7439-c851-4130-ab27-e8af143f6f9c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Aug 08 17:10:52.911958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 562/1218] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:53.832540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:53.833161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:53.839691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:53.840118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:53.840570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:53.841301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:53.841764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:53.842220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:53.974543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:53.982029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-22f34732-8166-4654-97f9-5981c0e8a896 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153310 Aug 08 17:10:53.982602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 563/1219] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:53.987158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:53.989945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:53.995617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:53.996110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:53.996556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:53.997313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:53.997813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:53.998337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:54.026584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0124bc76-ca0c-445c-b319-e08f21c12e0f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042986 Aug 08 17:10:54.027138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 564/1220] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:54.031580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:54.033997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:54.040047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:54.040541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:54.040984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:54.041676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:54.042161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:54.042596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:54.070944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f0266ffc-15ad-43df-ae1d-cf59076f79a6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 Aug 08 17:10:54.071492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 565/1221] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:55.004670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:55.005838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:55.012261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.012746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.013190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.013917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.014379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.014810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.143867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:55.151523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d3fe106f-71b5-4348-bbab-2d0a81fba5bb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150895 Aug 08 17:10:55.152081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 566/1222] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:55.156629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:55.159028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:55.165767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.166595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.167315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.168134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.168592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.169020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.198724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-36a282fd-18aa-49df-9578-683e80888b15 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045637 Aug 08 17:10:55.199282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 567/1223] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:55.203692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:55.205780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:55.211433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.211914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.212352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.213034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:55.213485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:55.213930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:55.243718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-99f85f8e-2010-4211-8ac4-38d1aac55282 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Aug 08 17:10:55.244272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 568/1224] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:56.176635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:56.177259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:56.183551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.184027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.184456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.185141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.185592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.186041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.315603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:56.323871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5f574cec-2c05-406f-b393-0fbbd0cbe538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151135 Aug 08 17:10:56.324443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 569/1225] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:56.328988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:56.331147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:56.337622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.338140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.338579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.339276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.339731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.340148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.369113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8ec748c0-410f-425a-a976-2dd7f120ae6c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043646 Aug 08 17:10:56.369662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 570/1226] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:56.374088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:56.376151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:56.382341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.382818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.383253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.383941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:56.384391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:56.384812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:56.413727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dc21b61e-b489-4f43-983a-33d27311bda7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Aug 08 17:10:56.414307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 571/1227] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:57.346284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:57.346935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:57.353883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.354371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.354817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.355511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.355968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.356395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.489128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:57.496748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6dadaec3-751b-4ed6-aec7-957388c5a611 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154329 Aug 08 17:10:57.497311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 572/1228] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:57.501839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:57.503999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:57.509654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.510182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.510623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.511313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.511767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.512191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.541410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-63b48525-a0ad-41a4-b60a-846cc858fc2a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043060 Aug 08 17:10:57.541996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 573/1229] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:57.546427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:57.548505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:57.554021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.554501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.554942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.555625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:57.556081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:57.556511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:57.585545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e1c68292-448c-43e8-a863-df3d933e2263 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Aug 08 17:10:57.586139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 574/1230] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:58.517863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:58.518512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:58.524967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.525462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.525943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.526649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.527112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.527543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.668115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:58.675922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c4cda437-5d53-402d-a991-552e2dfa1da9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.162024 Aug 08 17:10:58.677021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 575/1231] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:58.681546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:58.683706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:58.689225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.689710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.690221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.690888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.691342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.691775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.720413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c279a393-226c-431d-baff-7214b852bed7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042350 Aug 08 17:10:58.720967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 576/1232] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:58.726028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:58.728137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:58.733751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.734387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.734826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.735521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:58.735977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:58.736402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:58.765029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eca69324-3bef-42de-903c-c49607d2b9e3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Aug 08 17:10:58.765583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 577/1233] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:59.698590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:59.699235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:59.705656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.706181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.706621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.707313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.708255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.708678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.712605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:59.843771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:59.852137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a921eed8-27a0-41c0-82c3-293b000ba999 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.157512 Aug 08 17:10:59.852699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 578/1234] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:10:59.857326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:59.859525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:59.865182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.868913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.868913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.868913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.868913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.869876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.898711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f0256c40-d9b0-4f95-a3a8-574aa266a676 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044984 Aug 08 17:10:59.899266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 579/1235] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:10:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:10:59.903668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:59.905762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:59.912035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.912512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.912947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.913629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:59.914104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:59.914524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:59.943190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ad325ad0-5085-4df7-ac27-66f0fde0d952 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Aug 08 17:10:59.943661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 580/1236] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:10:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:00.873018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:00.873658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:00.880585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:00.881079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:00.881528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:00.882259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:00.882727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:00.883160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:01.013262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:01.020748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-19f4a037-dd06-43e4-aadb-9046c02d8e5a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151679 Aug 08 17:11:01.021308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 581/1237] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:01.030086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:01.030086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:01.034053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:01.034539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:01.034980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:01.035677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:01.036132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:01.036556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:01.065071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a6784afe-eeb9-4f16-bf2f-6453ecaa4e67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042757 Aug 08 17:11:01.065622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 582/1238] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:01.070768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:01.072874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:01.078710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:01.079197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:01.079641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:01.080341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:01.080803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:01.081235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:01.109876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0d39b9c2-0b45-4a49-834e-f0f617d5acd3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Aug 08 17:11:01.110439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 583/1239] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:02.042503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:02.043210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:02.049501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.050151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.050456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.051150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.051601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.052022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.186346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:02.194536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3bca51a4-61ef-4a6a-90eb-58ee36728a82 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155845 Aug 08 17:11:02.195100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 584/1240] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:02.199835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:02.204350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:02.215093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.215577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.216014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.216711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.217166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.217591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.245301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4e6f67df-c9e1-4502-98c2-5ecc0cf6b237 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049128 Aug 08 17:11:02.245867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 585/1241] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:02.250266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:02.252361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:02.258493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.258967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.259401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.260087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:02.260541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:02.260964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:02.289838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0edd56af-8f9a-4cb1-beca-6defe41e8e29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Aug 08 17:11:02.290392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 586/1242] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:03.216304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:03.216984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:03.223894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.224372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.224804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.225492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.225992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.226416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.357448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:03.364995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4898177e-b563-4123-83ba-747631b496b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152534 Aug 08 17:11:03.365588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 587/1243] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:03.370269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:03.372369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:03.378129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.378615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.379067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.379769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.380226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.380652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.410100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0d2edaee-7367-4bf5-83b2-ac086607e59b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Aug 08 17:11:03.411287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 588/1244] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:03.415982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:03.418122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:03.423769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.424251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.424691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.425378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:03.425864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:03.426343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:03.454509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8d721244-8e16-4e98-96ed-98821e2e145a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Aug 08 17:11:03.459712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 589/1245] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:04.385100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:04.385761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:04.392226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.392708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.393147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.393919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.394319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.394750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.524135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:04.532184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-710564c7-e427-4e30-976e-cc685a26e0c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150609 Aug 08 17:11:04.533028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 590/1246] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:04.538834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:04.541025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:04.546944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.547438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.547884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.548593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.549052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.549483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.579018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5aaff865-c34e-4587-b0b5-ed66aa599214 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044819 Aug 08 17:11:04.579464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 591/1247] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:04.583983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:04.586213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:04.592227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.592722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.593168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.593918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:04.594386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:04.594819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:04.626467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-daab6cbc-939c-43db-9b00-5b8cd1af4c57 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Aug 08 17:11:04.627045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 592/1248] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:05.554364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:05.555057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:05.561330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.561825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.562260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.562945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.563398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.563820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.697758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:05.705277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-90c29e96-b4ac-4cad-85c7-e9052f450f21 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154830 Aug 08 17:11:05.705863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 593/1249] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:05.710909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:05.713027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:05.718618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.719102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.719545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.720235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.720692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.721118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.746042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:05.750705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1e34d9c5-6722-43ff-871d-88fc626bb420 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043885 Aug 08 17:11:05.751265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 594/1250] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:05.756071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:05.758116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:05.766312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.766312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.766312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.766312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:05.766786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:05.766786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:05.796346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bf8504bb-3b82-49c7-af1d-e4dfb626b476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 08 17:11:05.796897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 595/1251] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:06.727079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:06.727747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:06.734468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.734951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.735388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.736086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.736536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.736958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.867891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:06.875428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9023a323-0680-4f3a-a1cc-58dfa7bd1233 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152481 Aug 08 17:11:06.875992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 596/1252] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:06.881098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:06.883261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:06.888840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.889329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.889772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.890504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.890962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.891391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.920623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-70eafac3-e76c-47eb-8ba1-603d5a3d3d37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043613 Aug 08 17:11:06.921176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 597/1253] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:06.925741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:06.927966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:06.933506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.934038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.934482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.935171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:06.935629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:06.936056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:06.966939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-943050fe-0bb3-48a1-880d-f6b608df35ae tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Aug 08 17:11:06.967500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 598/1254] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:07.896435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:07.897057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:07.903560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:07.904043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:07.904479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:07.905171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:07.905628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:07.906092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:08.039646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:08.047123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5c3dfcb5-ba12-4669-9f50-f4fb3d7fef1f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154527 Aug 08 17:11:08.047682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 599/1255] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:08.052735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:08.054881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:08.060587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:08.061073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:08.061509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:08.062235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:08.062689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:08.063117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:08.092297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-84b46be3-fadb-4592-ab7a-24966a2de83f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043604 Aug 08 17:11:08.092847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 600/1256] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:08.097559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:08.100190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:08.106004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:08.106488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:08.106944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:08.107630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:08.108091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:08.108521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:08.140540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-173f65d6-b169-4f05-a51a-221b0a822835 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Aug 08 17:11:08.141019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 601/1257] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:09.069037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:09.069714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:09.076230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.076720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.077160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.077884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.078348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.078780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.208124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:09.215570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb87ed72-2b99-4314-8439-b78320f1b8de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.150883 Aug 08 17:11:09.216132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 602/1258] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:09.220714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:09.222880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:09.228695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.229179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.229615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.230349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.230822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.231244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.260817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7ae4d2bf-4c19-4b34-842f-6f0ecf25c52c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043689 Aug 08 17:11:09.261362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 603/1259] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:09.265752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:09.267869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:09.273344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.273857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.274298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.274979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:09.275440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:09.275866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:09.304970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7d6037d-d49e-4410-b883-4ad54d410000 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Aug 08 17:11:09.305517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 604/1260] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:10.236265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:10.237026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:10.243506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.243989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.244421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.245114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.245567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.246023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.375446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:10.383846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6437d8af-445e-4de5-af88-4db76d90b7cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151437 Aug 08 17:11:10.384410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 605/1261] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:10.388917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:10.391063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:10.397400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.397902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.398337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.399023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.399471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.399908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.427801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87a34d6d-eca1-44a7-881f-b5685e145125 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042402 Aug 08 17:11:10.428350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 606/1262] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:10.432716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:10.434827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:10.440493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.440975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.441409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.442755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:10.443212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:10.443638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:10.472381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c02f78a3-961c-4242-bdd0-253a424c296d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Aug 08 17:11:10.472965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 607/1263] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:11.405853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:11.406528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:11.413695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.414212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.414674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.415348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.415812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.416231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.550466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:11.558228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-48c0fd16-8b40-4515-ae4c-60235944fdf6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156233 Aug 08 17:11:11.558796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 608/1264] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:11.563771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:11.565913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:11.571647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.572410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.572576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.573269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.573725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.574171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.604454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9cc8b57b-153a-47fe-bf3e-205b5d3056e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044615 Aug 08 17:11:11.605014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 609/1265] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:11.609493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:11.611634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:11.617229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.617712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.618187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.618876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:11.619334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:11.619760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:11.649156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-de806622-19e9-473d-ad8b-cb9d52dab295 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Aug 08 17:11:11.649722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 610/1266] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:12.579249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:12.579927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:12.583798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:12.587189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.587678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.588120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.588823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.589286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.590031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.609027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:12.759946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:12.768908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8b33fc31-25c7-4d5c-b919-5fee67226222 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.193332 Aug 08 17:11:12.770442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 611/1267] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:12.779262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:12.783277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:12.794365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.795370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.796043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.796821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.797337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.797921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.829779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0dd5ea1b-4570-4976-93c4-92dd0bb5de70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057890 Aug 08 17:11:12.830311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 612/1268] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:12.839216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:12.841345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:12.847258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.847782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.848582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.848951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:12.849373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:12.849819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:12.878552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b41f72b8-b076-4f79-a518-b3ebb0a7df41 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Aug 08 17:11:12.879676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 613/1269] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:13.803658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:13.804310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:13.810837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:13.811333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:13.811780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:13.812482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:13.812947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:13.813382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:13.946377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:13.953844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07f966fc-f438-4a7c-8527-d0a2625f2c38 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154117 Aug 08 17:11:13.954421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 614/1270] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:13.960543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:13.962712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:13.968446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:13.968935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:13.969377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:13.970102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:13.970565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:13.971110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:13.999549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ef6971d4-814b-412c-b6fc-7c69d423a9b4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044141 Aug 08 17:11:14.000104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 615/1271] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:14.004756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:14.006912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:14.012579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:14.013064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:14.013508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:14.014245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:14.014710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:14.015140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:14.044352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cc613bfc-dd3a-42ee-ae2b-3c0a86aac6a3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 08 17:11:14.044910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 616/1272] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:14.975849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:14.976530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:14.982876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:14.983361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:14.983790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:14.984472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:14.984956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:14.985377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:15.117272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:15.124732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bcb8ade2-de75-459b-aa82-62162a9189fd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152783 Aug 08 17:11:15.125284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 617/1273] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:15.130465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:15.132575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:15.138323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:15.138802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:15.139237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:15.139928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:15.140383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:15.140806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:15.169673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e925face-e415-4850-a936-fbab84de891d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043325 Aug 08 17:11:15.170243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 618/1274] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:15.174827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:15.176911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:15.182501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:15.182983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:15.183418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:15.184133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:15.184582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:15.185005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:15.213814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8161d209-d338-434c-a940-5a8f4e11736d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Aug 08 17:11:15.214371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 619/1275] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:16.146967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:16.147619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:16.153435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.153947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.154381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.155341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.155791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.156213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.288527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:16.295941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-126f0ebb-9cb4-4231-ab76-17c7f706471c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153630 Aug 08 17:11:16.296505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 620/1276] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:16.301224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:16.303368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:16.309555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.310069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.310513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.311197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.311648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.312069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.341078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4f8dcebc-eabc-4dcf-a48f-a6d321ccfb30 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043550 Aug 08 17:11:16.341630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 621/1277] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:16.346047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:16.348740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:16.354291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.354767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.355198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.355878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:16.356327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:16.356756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:16.385246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d433cebc-9725-406c-8ac7-c23b8f4c5add tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Aug 08 17:11:16.385817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 622/1278] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:17.317478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:17.318192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:17.324617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.325098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.325535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.326255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.326706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.327135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.456666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:17.464845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c1eee69e-e0a4-4c79-a551-23107fdd7747 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151700 Aug 08 17:11:17.467258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 623/1279] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:17.469936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:17.472062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:17.478008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.478501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.478944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.479804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.480258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.480688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.510828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-496f2c5b-4b96-4974-bd3e-646da8611d27 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044372 Aug 08 17:11:17.511390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 624/1280] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:17.515909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:17.518122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:17.523779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.524268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.524711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.525410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:17.525897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:17.526326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:17.554839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-235d937a-1855-4864-b382-c4220773030a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Aug 08 17:11:17.555392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 625/1281] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:18.487289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:18.488598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:18.495143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.495629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.496066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.496787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.497245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.497664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.631499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:18.638925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3faecc2f-da9e-4155-8268-275f3bed7964 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155629 Aug 08 17:11:18.639484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 626/1282] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:18.644240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:18.646538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:18.652382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.652871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.653304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.654024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.654474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.654896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.685355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5e9700b9-b044-415a-8489-dd365b677753 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044780 Aug 08 17:11:18.685838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 627/1283] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:18.690580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:18.692656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:18.698280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.698762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.699199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.699882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:18.700329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:18.700746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:18.704226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:18.729297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9fc45e12-22f4-41dc-994b-cb955d436c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Aug 08 17:11:18.729876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 628/1284] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:19.660738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:19.661376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:19.667933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.668416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.668855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.669548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.670037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.670469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.799331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:19.807284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11ec87a7-d0fa-4b3d-a548-d70aebb2859a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151366 Aug 08 17:11:19.807843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 629/1285] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:19.812513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:19.814714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:19.821179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.829160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.829160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.829160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.829160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.829525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.852073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ee87141e-b550-4ac4-9078-aa25b1d31766 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043168 Aug 08 17:11:19.852553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 630/1286] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:19.857154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:19.859249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:19.865311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.865809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.866243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.866927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:19.867376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:19.867797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:19.896291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-14448549-d71a-44cd-b648-1cd31f07fc01 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042751 Aug 08 17:11:19.896844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 631/1287] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:20.828709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:20.829368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:20.836432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:20.836920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:20.837359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:20.838112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:20.838574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:20.839005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:20.971815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:20.979498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0bd42b80-f20a-4623-9938-971b7df1b599 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154687 Aug 08 17:11:20.980064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 632/1288] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:20.984727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:20.986889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:20.992512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:20.992994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:20.993435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:20.994179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:20.994628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:20.995066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:21.024023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-319c23b8-17fe-44e8-a3d7-f54a8d34620f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042949 Aug 08 17:11:21.024573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 633/1289] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:21.029140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:21.031239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:21.037276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:21.037766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:21.038235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:21.038931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:21.039388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:21.039815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:21.068252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d1637954-cafb-4216-bb0a-3a8e41e0b91d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 Aug 08 17:11:21.068814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 634/1290] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:22.000373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:22.000997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:22.008057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.008538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.008976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.009680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.010160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.010588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.143565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:22.151319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4203e47b-3f7d-4302-b2f1-200c2c754887 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.154808 Aug 08 17:11:22.151886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 635/1291] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:22.156502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:22.158917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:22.164900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.165434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.165905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.166667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.167125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.167575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.197511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f0dc911f-2b66-47d0-94fb-ce9ade6c42bd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044595 Aug 08 17:11:22.198103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 636/1292] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:22.202697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:22.204845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:22.210554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.211089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.211532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.212250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:22.212711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:22.213144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:22.243057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6998903d-bb10-4048-9620-6165470afc3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Aug 08 17:11:22.243615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 637/1293] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:23.172545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:23.173185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:23.179595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.180075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.180514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.181198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.181649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.182100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.310517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:23.318496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ca03bc4f-0659-4616-8a13-5ab2d064c29f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.149800 Aug 08 17:11:23.319066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 638/1294] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:23.323935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:23.326088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:23.332740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.333257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.333689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.334425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.334878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.335300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.363837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2334f7a4-b3ee-4e03-acf9-dd8ae735a131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Aug 08 17:11:23.364397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 639/1295] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:23.369088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:23.371224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:23.377099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.377578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.378041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.379234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:23.379684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:23.380107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:23.409829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1c934aa9-0dc6-4787-8ca4-551de628f550 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 08 17:11:23.410386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 640/1296] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:24.342608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:24.343275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:24.350355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.350842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.351299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.352142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.352659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.353089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.493122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:24.500626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b895da99-911f-4725-9560-6180c7c97535 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.161974 Aug 08 17:11:24.501191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 641/1297] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:24.505728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:24.507884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:24.513589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.514108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.514552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.515251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.515707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.516134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.545764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1df677b1-e7aa-4ccb-85da-cc3dcac2f71e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043565 Aug 08 17:11:24.546336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 642/1298] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:24.550940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:24.553046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:24.558757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.559242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.559684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.560375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:24.560831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:24.561265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:24.590131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-14dd34e8-e252-4c1c-a570-3bc6886aafed tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Aug 08 17:11:24.590698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 643/1299] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:25.522656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:25.523325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:25.529641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.530148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.530593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.531279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.531732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.532434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.661352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:25.664793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:25.669272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1857c037-1ff9-4950-84a7-70db5eea42e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.151291 Aug 08 17:11:25.669850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 644/1300] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:25.674463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:25.676617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:25.682871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.683181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.683623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.684323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.684782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.685210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.716493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-158cb8a0-9c85-4a48-bf35-d876ee4ace29 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045568 Aug 08 17:11:25.717049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 645/1301] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:25.721543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:25.723958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:25.731875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.732353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.732788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.733486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:25.733987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:25.734414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:25.764302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f27d13f-2338-40da-b412-6253dc9a0d91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Aug 08 17:11:25.764854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 646/1302] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:26.690721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:26.691387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:26.697756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.698267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.698701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.699390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.699842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.700262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.830949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:26.839101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6327bfba-9e09-4e40-9c41-b539f7f3a5a8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152391 Aug 08 17:11:26.839901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 647/1303] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:26.844723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:26.846880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:26.853419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.854028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.854468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.855162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.855615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.856037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.885838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1e1ada1b-a9c8-4a3b-b194-f0daa57980a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Aug 08 17:11:26.886400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 648/1304] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:26.890870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:26.892960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:26.899489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.899974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.900415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.901108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:26.901565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:26.902024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:26.931439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87e1256c-cf03-417f-b1c5-e462df360341 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 08 17:11:26.931985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 649/1305] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:27.861545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:27.862300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:27.869064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:27.869548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:27.870028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:27.870728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:27.871185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:27.871613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:28.003589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:28.011168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-34740651-46df-4877-ac7d-b86c6edc5885 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.153875 Aug 08 17:11:28.011728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 650/1306] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:28.016245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:28.018379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:28.024488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:28.024971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:28.025409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:28.026127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:28.026579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:28.027004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:28.058236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d572261a-edfd-483c-a18f-857dd9443b84 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045448 Aug 08 17:11:28.058786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 651/1307] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:28.063407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:28.065500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:28.071753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:28.072261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:28.072700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:28.073388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:28.073868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:28.074297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:28.102807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-436debb7-ef63-4679-8973-94f4b5bb0574 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Aug 08 17:11:28.103347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 652/1308] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:29.032907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:29.033549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:29.040081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.040561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.040993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.041685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.042164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.042587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.176880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:29.184405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e559a8fc-21e6-47b0-852a-8738eb42aa7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.155644 Aug 08 17:11:29.184960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 653/1309] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:29.189585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:29.191757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:29.197586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.198107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.198543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.199244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.199695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.200116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.228756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2566251f-fb12-49e9-b49e-2bcc6bf01ba2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042803 Aug 08 17:11:29.229307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 654/1310] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:29.233754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:29.235848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:29.242043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.242521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.242955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.243641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:29.244090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:29.244513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:29.272150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87e12cad-3e3d-4f25-b125-c5dc4baa91d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Aug 08 17:11:29.272703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 655/1311] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:30.205390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:30.206035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:30.213035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.213578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.214056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.214807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.215267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.215694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.349923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:30.357399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2698b312-e1b9-4245-9942-03f7787e9a91 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.156010 Aug 08 17:11:30.357980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 656/1312] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:30.362544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:30.365169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:30.371345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.371830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.372273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.372978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.373435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.373899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.403654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b7ff49f9-8391-4bbf-8042-4cfe8a781255 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044624 Aug 08 17:11:30.404220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 657/1313] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:30.408929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:30.411072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:30.416683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.417169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.417616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.418334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:30.418792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:30.419219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:30.448035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-437dbe6f-1407-4af7-822b-ed1d57a4861e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Aug 08 17:11:30.448584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 658/1314] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:31.379775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:31.380472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:31.387032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.387514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.387950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.388635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.389085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.389505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.520147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:31.527843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7b0e339-479e-419a-8c6a-b261f5854bb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152888 Aug 08 17:11:31.528402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 659/1315] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:31.533222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:31.535372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:31.541073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.541557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.542025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.542714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.543163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.543583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.572283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3380311-aed0-4fb3-89d2-eb74bd0b523f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042869 Aug 08 17:11:31.572849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 660/1316] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:31.577246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:31.579380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:31.582765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:31.586090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.586573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.587009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.587708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:31.588161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:31.588669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:31.611570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:31.634740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b533bf8c-7465-413b-9723-bbd0577b6946 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060617 Aug 08 17:11:31.635709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 661/1317] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:32.550213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:32.551264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:32.557398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.557904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.558342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.559040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.559494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.559923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.700520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:11:32.708636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-120abd14-b45c-44a0-bb5c-209de3f9f84a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.162903 Aug 08 17:11:32.709198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 662/1318] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:11:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:11:32.717016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:32.717016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:32.722690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.723187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.723630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.724367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.724824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.725252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.753923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-832b1abc-c4f2-437e-b7f1-4672121da31c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043681 Aug 08 17:11:32.754488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 663/1319] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:11:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:11:32.758973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:32.763016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:32.766711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.767199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.767642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.768334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.769280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.769708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.799711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2e90e22-a9aa-4060-b6f5-290d11002132 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 08 17:11:32.800400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 664/1320] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:11:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:11:32.804978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:11:32.805467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:11:32.811150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.811638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.812081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:32.812780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:11:32.813238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:11:32.813666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:11:37.223051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:11:37.288536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:11:42.809478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=8 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:47.227830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:47.293987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=28 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:11:59.813201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:11:59.813861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:12:29.384801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:12:29.385480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:12:32.978822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:12:32.981028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:12:32.982637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:12:32.983645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:12:32.985135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:32.986663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:12:32.988892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) Aug 08 17:12:32.990245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:12:32.991847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3d847b3-4eb9-4033-9b67-cbe9e539c923) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:12:32.991847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e5740f1-4c4c-4055-b804-2c64b45b4c3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 119.837902 Aug 08 17:12:32.991847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 657/1321] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:10:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 119839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:12:32.991847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:12:32.992204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:12:32.995697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:32.998792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:32.998792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:32.998792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:32.998792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:32.999149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.059078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:12:33.061423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:12:33.062817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:12:33.063700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:12:33.064769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:33.067814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:12:33.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) Aug 08 17:12:33.072758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:12:33.075867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0431d567-99ff-4485-aec3-f9c753af4c3c) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:12:33.075867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff00a175-231f-461e-a597-bf9284ac3294 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 60.261569 Aug 08 17:12:33.075867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 665/1322] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:11:32 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 60263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:12:33.075867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:12:33.076581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:12:33.082375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.083062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.083332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.084350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.084541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.084923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.116197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-393db4a7-950c-4e0e-b7b3-c6f9c963361d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050913 Aug 08 17:12:33.116773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 666/1323] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Aug 8 17:12:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:12:33.147064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:12:33.154425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9a06c379-55b7-4832-920c-240295bc1237 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.170332 Aug 08 17:12:33.155234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 658/1324] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:12:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:12:33.188863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:12:33.191091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:12:33.197069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.197558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.198047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.198744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.199207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.199634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.229815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-386059c1-536d-4c7a-95c6-3faf4b4f773b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112001 Aug 08 17:12:33.230593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 667/1325] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:12:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:12:33.235278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:12:33.235765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:12:33.238751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:12:33.239421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:12:33.241684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.242211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.242654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.243351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.243811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.244238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.245834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.246410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.247083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:33.247969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:12:33.248424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:12:33.248851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:12:43.239178 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=6 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:12:43.244157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:12:43.262329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=16 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:12:43.267327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=10 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:13:37.380435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:13:37.421075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid ce9e3502-9913-4006-a9e2-a7c235f37e0d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:13:41.552608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:41.553441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:13:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:13:44.371352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:44.371947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 (ip 10.222.0.57) !!! Aug 08 17:13:45.413226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:45.413823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:13:47.384285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:13:47.425559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:14:33.123422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:14:33.125693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:14:33.127753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:14:33.128863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:14:33.132688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:14:33.134073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:14:33.135324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) Aug 08 17:14:33.136654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:14:33.138114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a7e3cb8-613b-436d-8ac6-268d83744077) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:14:33.138114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c195a38c-089c-456a-a6fb-954594a54469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 119.896132 Aug 08 17:14:33.138114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 668/1326] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:12:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 119897 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:14:33.138114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:14:33.138471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:14:33.143677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.143846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.144261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.144966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.145442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.145892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.266997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action" status: 200 len: 37762 microversion: 2.20 time: 0.137256 Aug 08 17:14:33.268358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action (ip 10.222.0.57) !!! Aug 08 17:14:33.268476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:14:33 2022 - uwsgi_response_write_body_do(): Broken pipe [core/writer.c line 341] during POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action (10.222.0.57) Aug 08 17:14:33.269299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: CRITICAL nova [None req-41c210d0-a51c-44f5-a9f2-65dc56868059 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Unhandled error: OSError: write error Aug 08 17:14:33.269299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova OSError: write error Aug 08 17:14:33.269299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova Aug 08 17:14:33.269588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 669/1327] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Aug 8 17:14:33 2022] POST /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea/action => generated 36183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (0 switches on core 0) Aug 08 17:14:33.274613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-97aee5a8-ffda-4efd-9fbf-41a548cd9743 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8" status: 202 len: 0 microversion: 2.1 time: 120.115595 Aug 08 17:14:33.276547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:14:33.276665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 659/1328] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:12:33 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 => generated 0 bytes in 120120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:14:33.276756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:14:33.283594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.284123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.284563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.285424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.285985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.286629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.294844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:14:33.297276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:14:33.305016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.305507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.306050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.306944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.307663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.308097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.340699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ad9b1fc-83c9-4696-8f17-df49985845f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063344 Aug 08 17:14:33.341216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 660/1329] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:14:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:14:33.345818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:14:33.346317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:14:33.352169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.352651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.353085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.353817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.354289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.354829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.435884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:14:33.443969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f1b4822f-57c1-4144-8cfe-88f44fc7510e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.173235 Aug 08 17:14:33.444554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 670/1330] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:14:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:14:33.449104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:14:33.449599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:14:33.456011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.456496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.456934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:33.457632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:14:33.458123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:14:33.458552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:14:43.349862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:14:43.374120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:14:43.453574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=6 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:14:43.476769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=14 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:15:19.822768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:15:19.823417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 (ip 10.222.0.57) !!! Aug 08 17:15:37.713901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid ce9e3502-9913-4006-a9e2-a7c235f37e0d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:15:37.912508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:15:47.718219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:15:47.917400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=4 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:16:33.376690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Request method failure captured: Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 HTTP/1.1 Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGVyIjUpM7AoMQrcMyhTR7AY55hoAc3uSnbjnK6HMP9yD_o4zrSyFrhAUMQMO2EsZsss7Lg451l_V4UoUejd572weHrx2BgSI1GfYG6zwFSYpx-_HBVJmHD1X6rsP9aRdArQpXtuPLk5--kx6o9qmrEsvZsjyFUaGJmNfF-CD3SjpE Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:16:33.379044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63b568870ecc4e4797919608bd9273ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: e941c29e3df944a08f18f5e029a28977 Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.380548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': 'ce9e3502-9913-4006-a9e2-a7c235f37e0d', 'id': 'e5730ad8-3b80-4faa-a777-bc5496f918a8'} Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.381484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.382666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.383831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.384884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) Aug 08 17:16:33.386168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.387255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-863d39c9-8733-4f51-9c75-1bf729a7a255) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:33.387255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7cdffda-64c8-4618-9646-629c58ace8ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8" status: 400 len: 269 microversion: 2.1 time: 120.038366 Aug 08 17:16:33.387255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 661/1331] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:14:33 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 => generated 269 bytes in 120039 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:33.388086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.388695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.394756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.395236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.395669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.396361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.396811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.397485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.413506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:16:33.415989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.421197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.426029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.432497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.435542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) Aug 08 17:16:33.438778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.442695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2eea1640-faf9-4cc6-8559-ba09b7ac6fc2) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:33.442695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a00b85d3-66f2-409a-ae50-1ff2cada102a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 119.971983 Aug 08 17:16:33.442695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 671/1332] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:14:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 119974 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:33.442695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.443555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.443555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.443555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.443555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.444093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.444093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.444093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.474908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-811bb72e-6cbf-4298-97e5-1f3355a80e26 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054787 Aug 08 17:16:33.475469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 672/1333] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:16:33.484901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.484901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.487249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.487738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.488182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.488883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.489344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.489772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.533057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:33.540735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-58b2b577-776b-4031-ae83-f1634fb7e32c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.158764 Aug 08 17:16:33.541307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 662/1334] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:16:33.546482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.546972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.554573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.555052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.555485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.556167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.556620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.557346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.571215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid ce9e3502-9913-4006-a9e2-a7c235f37e0d {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:33.636146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:33.670225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Request method failure captured: Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 HTTP/1.1 Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UGVyIjUpM7AoMQrcMyhTR7AY55hoAc3uSnbjnK6HMP9yD_o4zrSyFrhAUMQMO2EsZsss7Lg451l_V4UoUejd572weHrx2BgSI1GfYG6zwFSYpx-_HBVJmHD1X6rsP9aRdArQpXtuPLk5--kx6o9qmrEsvZsjyFUaGJmNfF-CD3SjpE Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:16:33.672388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63b568870ecc4e4797919608bd9273ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: e941c29e3df944a08f18f5e029a28977 Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.673930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': 'ce9e3502-9913-4006-a9e2-a7c235f37e0d', 'id': 'e5730ad8-3b80-4faa-a777-bc5496f918a8'} Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.675861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.677208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.678441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) Aug 08 17:16:33.679731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.680937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-766a1038-f30e-4c4a-842d-07b2f4ddf91f) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:33.680937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b0a16998-04bb-47ed-8524-d78ece6248da tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8" status: 400 len: 269 microversion: 2.1 time: 0.197286 Aug 08 17:16:33.680937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 673/1335] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:33 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 => generated 269 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:33.680937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.681292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.685663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.686185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.686624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.687339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.687796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.688223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.710703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:16:33.712950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.714893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.715526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.716525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.717642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.718687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) Aug 08 17:16:33.719751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.720808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50caada8-a1b3-4376-9b02-bd9c16a91a27) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:33.720808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-08698a19-2fd8-4e6d-885e-abec3924d7cc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 0.173197 Aug 08 17:16:33.720808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 663/1336] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:33.720808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.722973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.728940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.729420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.729884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.731297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.731748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.732177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.761391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a336a473-4d7c-4bbe-bae9-27084055a13d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 08 17:16:33.761970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 664/1337] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:16:33.766451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.767148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.772650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.773133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.773565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.774273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.774725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.775147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.820739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:33.828349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0d020c20-9520-4840-93d9-275c7d37b4d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.152894 Aug 08 17:16:33.828923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 674/1338] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:16:33.833509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.834033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.840114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.840598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.841040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.841733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.842217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.842649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.856044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid ce9e3502-9913-4006-a9e2-a7c235f37e0d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:33.921736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:33.949819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Request method failure captured: Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 HTTP/1.1 Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGVyIjUpM7AoMQrcMyhTR7AY55hoAc3uSnbjnK6HMP9yD_o4zrSyFrhAUMQMO2EsZsss7Lg451l_V4UoUejd572weHrx2BgSI1GfYG6zwFSYpx-_HBVJmHD1X6rsP9aRdArQpXtuPLk5--kx6o9qmrEsvZsjyFUaGJmNfF-CD3SjpE Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:16:33.952015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63b568870ecc4e4797919608bd9273ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: e941c29e3df944a08f18f5e029a28977 Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:33.953392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': 'ce9e3502-9913-4006-a9e2-a7c235f37e0d', 'id': 'e5730ad8-3b80-4faa-a777-bc5496f918a8'} Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.961033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.962212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.963458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.965234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) Aug 08 17:16:33.966498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.967744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5c4db54b-f5c6-4a39-9bcb-64823630df30) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:33.967744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-25ba259c-af58-4f3b-bb52-5d1762743a8d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8" status: 400 len: 269 microversion: 2.1 time: 0.190532 Aug 08 17:16:33.967744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 665/1339] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:33 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 => generated 269 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:33.967744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:33.968125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:33.968125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.968125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.968125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.968466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:33.968466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:33.968466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:33.985934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:16:33.992733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:16:33.994333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.995071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:33.996200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.997339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:33.998552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) Aug 08 17:16:34.000110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.001511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a9d91b71-3634-4f4d-ac3f-4b8c3da9f52d) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:34.001511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5bfdaaec-ec8c-44bf-9bc2-e95343d7890a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 0.160671 Aug 08 17:16:34.001511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 675/1340] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:34.001511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:34.001891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:34.004801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.005314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.005747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.006461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.006914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.007336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.042298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e378d7a8-db1f-449f-a316-b43f18cdbb1c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050112 Aug 08 17:16:34.042892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 676/1341] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:16:34.047704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:34.048189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:34.053960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.054449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.054884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.055839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.056230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.056653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.122061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:34.130626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d098fa3a-849d-424f-9f2d-75f272ed9a93 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.175677 Aug 08 17:16:34.131350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 666/1342] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:16:34.137877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:34.138663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:34.141760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lazy-loading 'services' on Instance uuid ce9e3502-9913-4006-a9e2-a7c235f37e0d {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:34.149058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.149619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.150128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.150877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:34.151332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:34.152655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:34.199716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Request method failure captured: Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 HTTP/1.1 Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UGVyIjUpM7AoMQrcMyhTR7AY55hoAc3uSnbjnK6HMP9yD_o4zrSyFrhAUMQMO2EsZsss7Lg451l_V4UoUejd572weHrx2BgSI1GfYG6zwFSYpx-_HBVJmHD1X6rsP9aRdArQpXtuPLk5--kx6o9qmrEsvZsjyFUaGJmNfF-CD3SjpE Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:16:34.201700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63b568870ecc4e4797919608bd9273ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63b568870ecc4e4797919608bd9273ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 63b568870ecc4e4797919608bd9273ad Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1069868239 Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: e941c29e3df944a08f18f5e029a28977 Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-VolumesSnapshotTestJSON-1069868239-project Aug 08 17:16:34.203096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': 'ce9e3502-9913-4006-a9e2-a7c235f37e0d', 'id': 'e5730ad8-3b80-4faa-a777-bc5496f918a8'} Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:34.204016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:16:34.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.207336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:34.208316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) Aug 08 17:16:34.209397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:16:34.212113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08d932cb-4d8d-447f-b65b-b0b26e79fb20) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:16:34.212113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8fbc932c-1970-46b9-afb7-4651ef098316 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8" status: 400 len: 269 microversion: 2.1 time: 0.159238 Aug 08 17:16:34.212113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 677/1343] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:34 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d/os-volume_attachments/e5730ad8-3b80-4faa-a777-bc5496f918a8 => generated 269 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:16:34.256423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:16:35.057104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:16:35.059306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:35.065996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:35.066487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:35.066929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:35.067623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:35.068083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:35.068508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:35.093964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [1464124d-c497-4175-b58f-916c7ad37011] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 17:16:36.101013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [1464124d-c497-4175-b58f-916c7ad37011] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 51796. Aug 08 17:16:36.183670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ccdc3aeb-04f5-4ede-8f83-c503a765568a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/action" status: 200 len: 41183 microversion: 2.1 time: 1.132327 Aug 08 17:16:36.190713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 678/1344] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:16:35 2022] POST /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e/action => generated 41183 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:16:36.190713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:36.190713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:36.196822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:36.197304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:36.197745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:36.198461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:36.199418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:36.199844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:36.225059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Going to try to terminate instance {{(pid=130500) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:16:36.509639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-afbf22ff-a52f-4b97-8a01-b1a0bfb54636 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 204 len: 0 microversion: 2.1 time: 0.323874 Aug 08 17:16:36.510516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 679/1345] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:16:36 2022] DELETE /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:16:36.570445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:16:36.580745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:36.581220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:36.587438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:36.592035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] Creating event network-changed:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:16:36.596976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-fb4d5d81-7e3b-472c-bcc3-567e1ccbfbe6 req-880b2dff-ac5b-4161-8e6a-7212d9e5cdd1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085437 Aug 08 17:16:36.597594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 680/1346] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:16:36.602578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:36.603261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:36.609190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:36.609665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:36.610145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:36.610825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:36.611274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:36.611690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:36.835594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:36.843185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a1ebb048-4699-4f7b-b7b4-9a33ac7a3e75 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1569 microversion: 2.1 time: 0.244416 Aug 08 17:16:36.843752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 681/1347] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:16:37.864229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:37.864847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:37.871245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:37.871728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:37.872170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:37.872856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:37.873308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:37.873730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:38.004863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:38.012806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1cb72a91-7ff6-41df-8716-5f3a38c8e11e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152539 Aug 08 17:16:38.013372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 682/1348] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:39.033579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:39.034226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:39.040554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:39.041031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:39.041466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:39.042179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:39.042630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:39.043052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:39.172941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:39.180678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b46ccd5-0850-406f-99ba-d245b79bf283 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150974 Aug 08 17:16:39.181236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 683/1349] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:40.201800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:40.202413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:40.208716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:40.209194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:40.209625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:40.210398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:40.210852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:40.211270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:40.338091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:40.345543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff7defe8-a22f-4523-9707-222a32b9490a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148116 Aug 08 17:16:40.346141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 684/1350] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:41.366429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:41.367088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:41.373417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:41.373932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:41.374368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:41.375055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:41.375503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:41.375940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:41.508253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:41.516267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39de2756-4464-4f77-8964-e09b880ca0ec tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.153698 Aug 08 17:16:41.516831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 685/1351] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:42.537749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:42.538426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:42.545333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:42.545824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:42.546260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:42.546936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:42.547410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:42.547828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:42.676078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:42.679595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:16:42.683949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-19c6f5bd-aa15-42c0-ac3c-d5546e2bf141 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150033 Aug 08 17:16:42.687457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 686/1352] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:43.705672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:43.706366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:43.712930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:43.713408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:43.713870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:43.714557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:43.715008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:43.715429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:43.843998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:43.852096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f35377fc-499d-44d7-8365-f809cfbffeca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150603 Aug 08 17:16:43.852661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 687/1353] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:44.142932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=12 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:16:44.268816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=42 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:16:44.873087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:44.873619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:44.880058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:44.880543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:44.880977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:44.881666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:44.882161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:44.882588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:45.013432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:45.020822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-85965efa-b9a8-4ae3-afdb-42e8ba16e275 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151777 Aug 08 17:16:45.021388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 688/1354] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:46.042673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:46.043300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:46.050245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:46.050736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:46.051174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:46.051865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:46.052321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:46.052749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:46.179404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:46.187394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ef7e8399-6cf5-4d83-8b8a-1571cff37290 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148653 Aug 08 17:16:46.187960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 689/1355] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:47.207381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:47.208039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:47.214554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:47.215026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:47.215455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:47.216134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:47.216580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:47.216999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:47.347550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:47.355125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1f3ef5de-1336-44e5-af0f-505874ddd5b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151541 Aug 08 17:16:47.355728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 690/1356] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:48.376901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:48.377539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:48.383816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:48.384292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:48.384724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:48.385405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:48.385893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:48.386316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:48.517312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:48.524970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8bd47670-3423-407f-b6ed-044e4e376016 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152600 Aug 08 17:16:48.525532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 691/1357] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:49.545979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:49.546651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:49.553099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:49.553576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:49.554041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:49.554723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:49.555175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:49.555597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:49.686635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:49.694549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b7274e26-887d-4875-8fdc-f63ecfa150b2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152421 Aug 08 17:16:49.695115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 692/1358] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:50.715166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:50.716395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:50.722716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:50.723202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:50.723641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:50.724337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:50.724789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:50.725217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:50.855549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:50.862954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2a71a475-7fee-4105-b348-0c24ea3cdfb3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151707 Aug 08 17:16:50.863533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 693/1359] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:51.884321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:51.885019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:51.891438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:51.891924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:51.892365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:51.893060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:51.893540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:51.894000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:52.027598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:52.035251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87bbb86b-77a2-493d-ac8d-d7b59d38d4f6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.154883 Aug 08 17:16:52.035811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 694/1360] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:53.056440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:53.057091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:53.063895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:53.065289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:53.065289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:53.065550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:53.065966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:53.066394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:53.196275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:53.204216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-44d9a759-4071-452a-9795-0495a0f736cb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151555 Aug 08 17:16:53.204776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 695/1361] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:54.224795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:54.225415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:54.227939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:16:54.232589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:54.233069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:54.233503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:54.234216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:54.234669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:54.235090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:54.362008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:54.369378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ca620dcc-b8e9-438d-839f-b57c0b0c528e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148492 Aug 08 17:16:54.369968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 696/1362] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:55.389583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:55.390236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:55.396957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:55.397445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:55.397949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:55.398635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:55.399097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:55.399526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:55.532619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:55.540149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dd50ab1e-a18f-459b-bd51-330aab0a4527 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.154459 Aug 08 17:16:55.540752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 697/1363] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:56.561965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:56.562622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:56.569087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:56.569565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:56.570050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:56.570710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:56.571177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:56.571581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:56.697586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:56.705559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a7cf3e61-cb4a-46dc-892b-278d2ead50a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.147521 Aug 08 17:16:56.706151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 698/1364] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:57.726810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:57.727454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:57.734437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:57.734917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:57.735351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:57.736034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:57.736488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:57.736904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:57.866155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:57.873461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-60646c43-368e-4a89-8260-ea3550aeb333 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150470 Aug 08 17:16:57.874054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 699/1365] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:16:58.893953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:16:58.894585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:16:58.901195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:58.901686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:58.902160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:58.902854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:16:58.903315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:16:58.903772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:16:59.034693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:16:59.042123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56f25b6a-0c3b-45cd-b1c4-52b51dc724d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152079 Aug 08 17:16:59.042691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 700/1366] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:16:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:00.063644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:00.064261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:00.070722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:00.071207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:00.071645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:00.072342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:00.072799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:00.073227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:00.201144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:00.208820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4de312f5-fcfc-4105-a86d-7868ac42daca tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.149037 Aug 08 17:17:00.209386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 701/1367] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:01.229575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:01.230320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:01.236824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:01.237314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:01.237808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:01.238530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:01.238993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:01.239425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:01.371157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:01.379162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a7ffe9f8-e2d6-414d-84ac-d3abc4d69317 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.153417 Aug 08 17:17:01.379705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 702/1368] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:01.561587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:17:01.561773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:17:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:17:02.400714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:02.401331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:02.407669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:02.408158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:02.408600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:02.409301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:02.409760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:02.410221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:02.428264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:02.539298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:02.547533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6522b466-4d8d-4b31-a184-e19d6a193425 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150882 Aug 08 17:17:02.548099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 703/1369] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:03.568379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:03.569052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:03.575649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:03.576125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:03.576560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:03.577249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:03.577701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:03.578144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:03.707300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:03.714827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a7f2b31d-0bde-4e23-b1a8-9304e2c9398b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150243 Aug 08 17:17:03.715886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 704/1370] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:04.379526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:17:04.380064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:17:04.735675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:04.736290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:04.742671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:04.743148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:04.743581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:04.744262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:04.744713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:04.745134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:04.876106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:04.883465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-90de7a1d-a2ee-4d9b-a113-39560bad4930 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151698 Aug 08 17:17:04.884023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 705/1371] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:05.421383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:17:05.421613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:17:05.905757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:05.906452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:05.912848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:05.913332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:05.913771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:05.914483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:05.914939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:05.915369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:06.042514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:06.050519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2dca3bc7-1d4e-4014-bdc4-e9614f017b0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.149509 Aug 08 17:17:06.051077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 706/1372] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:07.071722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:07.072356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:07.078805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:07.079274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:07.079712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:07.080407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:07.080861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:07.081290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:07.211455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:07.219455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5b0f0e5c-1078-4c56-9c71-aee2b16ac87c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151583 Aug 08 17:17:07.230405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 707/1373] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:08.243294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:08.243924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:08.251057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:08.251536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:08.252000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:08.252685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:08.253145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:08.253567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:08.386537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:08.391425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2f17c974-b3dd-47bd-9f22-d4286a36b21c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151989 Aug 08 17:17:08.391981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 708/1374] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:09.412099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:09.412770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:09.419172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:09.420155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:09.420613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:09.421293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:09.421753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:09.422209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:09.552025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:09.559429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fcece2dc-eb2d-40b6-a982-548543949b4d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151301 Aug 08 17:17:09.559986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 709/1375] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:10.580902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:10.581564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:10.588145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:10.589057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:10.589057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:10.589730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:10.590254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:10.594052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:10.719434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:10.727217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3f477489-97fb-4ef8-af66-2034b9fb8b59 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150102 Aug 08 17:17:10.727890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 710/1376] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:11.748157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:11.748778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:11.755121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:11.755595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:11.756023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:11.756703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:11.757152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:11.757573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:11.885516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:11.892907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c2d407ef-ca71-4ef7-b8f4-3fb00696261e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148622 Aug 08 17:17:11.893450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 711/1377] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:12.914486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:12.915087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:12.921933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:12.922417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:12.922854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:12.923540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:12.924024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:12.924452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:13.055247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:13.063401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb4597cd-277f-49f1-a789-d30600adcfb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152810 Aug 08 17:17:13.063967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 712/1378] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:14.084552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:14.085167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:14.091619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:14.092097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:14.092535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:14.093223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:14.093676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:14.094125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:14.224799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:14.228658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8a50fcf-cd79-4b73-980e-da1deef3a1db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.147980 Aug 08 17:17:14.229222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 713/1379] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:15.250097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:15.250788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:15.257102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:15.257589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:15.258071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:15.258770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:15.259228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:15.259656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:15.389457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:15.397211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4587816a-c318-462f-954d-7b5c5d6aea2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151604 Aug 08 17:17:15.397777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 714/1380] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:16.418416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:16.419028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:16.425162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:16.425670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:16.426145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:16.426842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:16.427303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:16.427739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:16.560356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:16.568537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b7a1797-d45e-4a7b-b9c6-656fa15ede4a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.154104 Aug 08 17:17:16.569112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 715/1381] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:17.588812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:17.589438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:17.600486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:17.600967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:17.601397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:17.602122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:17.602604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:17.603022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:17.729914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:17.737373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-64ce98bf-6c80-418d-8313-ad609f969953 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.152383 Aug 08 17:17:17.737954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 716/1382] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:18.758036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:18.758714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:18.765518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:18.766099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:18.766536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:18.767224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:18.767677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:18.768102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:18.896882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:18.904215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ad25de73-3aaf-4a53-8971-141a33da52b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.150015 Aug 08 17:17:18.904780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 717/1383] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:19.926459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:19.927151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:19.933826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:19.945316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:19.945316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:19.945316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:19.945316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:19.946026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:20.148835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:20.156450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8ddacc11-102c-4825-8e3f-f6cf032fa1d3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.233935 Aug 08 17:17:20.157020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 718/1384] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:21.176842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:21.177499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:21.183790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:21.184265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:21.184692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:21.185369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:21.185834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:21.186259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:21.317271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:21.324895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7dbae43c-4d62-483c-b38b-e82fa36589cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151847 Aug 08 17:17:21.325456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 719/1385] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:22.351256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:22.351883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:22.358181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:22.358660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:22.359095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:22.360419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:22.360870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:22.361291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:22.365191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:22.487504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:22.495007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c88d4649-89e2-4667-99d9-36709fb59fd6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.147723 Aug 08 17:17:22.495564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 720/1386] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:23.515632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:23.516261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:23.522928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:23.523413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:23.523857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:23.524551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:23.525013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:23.525441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:23.892210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:23.899936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-707e624b-e81b-49ae-b3d4-d0969ff410d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.388163 Aug 08 17:17:23.900491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 721/1387] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:24.920837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:24.921454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:24.924212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=52 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:24.928842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:24.929324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:24.929763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:24.930501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:24.930946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:24.931370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:25.058407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:25.066445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b00e76ab-7e92-4f0d-9007-23f219f24cc3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.149539 Aug 08 17:17:25.067011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 722/1388] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:26.087112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:26.087762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:26.094690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:26.095172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:26.095610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:26.096298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:26.096752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:26.097176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:26.231912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:26.232068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-918934e1-6480-40e4-b7fc-6ef0ce77dd18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148662 Aug 08 17:17:26.232562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 723/1389] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:27.253262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:27.253936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:27.260370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:27.261214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:27.261377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:27.261981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:27.262445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:27.262869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:27.388350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:27.396016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1bbe7d05-0571-40cd-b36e-249a55ff0fac tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.147426 Aug 08 17:17:27.396581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 724/1390] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:28.417688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:28.418330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:28.425296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:28.425774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:28.426244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:28.426927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:28.427378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:28.427799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:28.560620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:28.568192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c015d322-c65e-4506-88d0-b98aaa670396 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.154360 Aug 08 17:17:28.568759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 725/1391] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:29.395489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:17:29.395969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 (ip 10.222.0.57) !!! Aug 08 17:17:29.589773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:29.590190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:29.596748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:29.597236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:29.597679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:29.598406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:29.598863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:29.599286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:29.727005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:29.735085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4bab1dd4-e951-48f1-b39e-bdfba46a4163 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.149100 Aug 08 17:17:29.735644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 726/1392] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:30.755645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:30.756294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:30.762610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:30.763090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:30.763532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:30.764216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:30.764666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:30.765086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:30.892401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:30.900119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11386f45-6c2d-4180-9c03-654dd2998ee6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.148279 Aug 08 17:17:30.900682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 727/1393] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:31.920174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:31.920805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:31.927724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:31.928210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:31.928647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:31.929340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:31.929817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:31.930243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:32.060443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:32.067940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7cc5fb64-8813-4f13-86b4-7aa1e5de4f15 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.151650 Aug 08 17:17:32.068508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 728/1394] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:33.019791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:33.020645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:33.026882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:33.027383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:33.027813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:33.028497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:33.028947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:33.029370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:38.158189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:17:38.160321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:17:38.167398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:17:38.168545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:17:38.170007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.171463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:17:38.172889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) Aug 08 17:17:38.174698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.176320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46df6e5e-6756-4e66-a4a7-68281de3fbdb) {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:17:38.176320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d167c9a2-f53c-4e57-a8b8-b0d2e52995b3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 64.029400 Aug 08 17:17:38.176320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 667/1395] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:16:34 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 64030 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:17:38.176320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:38.176717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:38.176717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:38.176717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:38.176717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:38.177117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:38.177346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:38.177774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:38.311412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:38.319626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-faa6b17f-2e1a-4ed7-805d-7b5802e5c0cf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1451 microversion: 2.1 time: 0.156038 Aug 08 17:17:38.320188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 668/1396] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:38.596405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.objects.instance [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'services' on Instance uuid 4529f181-c2fc-4f1e-b6a4-58352038bc0e {{(pid=130500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:17:38.781448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.wsgi [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: request: DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 HTTP/1.1 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept: application/json Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Accept-Encoding: identity Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Connection: close Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Length: 0 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Content-Type: application/json Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Host: 10.222.0.57 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Openstack-System-Scope: None Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: User-Agent: python-urllib3/1.26.11 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Id: None Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Domain-Name: None Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Identity-Status: Confirmed Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Is-Admin-Project: True Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Id: default Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Domain-Name: Default Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Role: member,reader Aug 08 17:17:38.783738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Roles: member,reader Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Id: default Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Domain-Name: Default Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:17:38.785930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: method: > Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: action_args: {'server_id': '4529f181-c2fc-4f1e-b6a4-58352038bc0e', 'id': '5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0'} Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:17:38.786621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 17:17:38.787687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.788851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:17:38.790039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) Aug 08 17:17:38.791114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: ERROR nova.api.openstack.wsgi Aug 08 17:17:38.792245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8f86ae3-1e43-4076-a25e-1726ea629166) {{(pid=130500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:17:38.792245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-374bb81f-c19b-428b-889b-ce7afdf7057e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0" status: 400 len: 269 microversion: 2.1 time: 5.769495 Aug 08 17:17:38.792245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 729/1397] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:17:33 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments/5b5a0c37-2b33-4ad5-93ce-5e26b7ad56c0 => generated 269 bytes in 5771 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 17:17:38.797714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:38.800070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:38.806328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:38.813939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:38.813939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:38.813939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:38.813939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:38.814378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:38.841415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cbae981b-7458-4fa7-8259-b90790b37dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047743 Aug 08 17:17:38.842119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 669/1398] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:39.213742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68ae2a9-75e7-4eba-b349-a5207bc78db2", "name": "network-vif-deleted", "tag": "547a9e4d-9228-4355-aacd-be91fe700c2f"}]} {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:17:39.224632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:39.231661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:39.231661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:39.238858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.compute.server_external_events [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] Creating event network-vif-deleted:547a9e4d-9228-4355-aacd-be91fe700c2f for instance e68ae2a9-75e7-4eba-b349-a5207bc78db2 on hv-cinder-85221 Aug 08 17:17:39.245820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [req-5ef47679-44fa-4094-b83f-f493fc267cfe req-7ab0a85c-46e1-4529-87c6-23f0385ac319 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097006 Aug 08 17:17:39.246413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 730/1399] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:39.339389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:39.340021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:39.346969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:39.347454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:39.347888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:39.348579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:39.349032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:39.349453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:39.414310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:39.422697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d698ab3c-1a14-4a6f-aea8-cadffd9a4d18 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086660 Aug 08 17:17:39.423262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 670/1400] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:39.854388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:39.856743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:39.862919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:39.863409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:39.863854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:39.864577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:39.865038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:39.865471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:39.893927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7427234a-9bbf-4c99-ac30-f71b76bab1d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 08 17:17:39.894466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 731/1401] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:40.443728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:40.444362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:40.450690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:40.451165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:40.451593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:40.452274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:40.452720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:40.453137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:40.519029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:40.525940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e985f0dc-c1bd-4190-abba-1345eb10106a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086008 Aug 08 17:17:40.526505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 671/1402] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:40.906280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:40.908476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:40.914891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:40.915374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:40.915811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:40.916501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:40.916960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:40.917386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:40.947710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87017414-ef16-4e81-bb4a-20bc49b34e17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Aug 08 17:17:40.948260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 732/1403] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:41.547020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:41.547739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:41.554346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:41.554853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:41.555331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:41.556013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:41.556529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:41.557030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:41.617108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:41.624574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-908e8b93-b3c9-463b-a4a6-5acff6550327 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081379 Aug 08 17:17:41.625122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 672/1404] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:41.960433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:41.962568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:41.968938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:41.969494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:41.969965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:41.970660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:41.971117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:41.971542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:41.999984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e137a1c1-36ed-4eca-a3dd-246145d61d1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Aug 08 17:17:42.001170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 733/1405] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:42.645583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:42.646219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:42.652596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:42.653077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:42.653512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:42.654230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:42.654688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:42.655117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:42.715314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:42.723303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e764b3a-3f4c-4801-892a-60df5b500fdb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081833 Aug 08 17:17:42.723858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 673/1406] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:43.012524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:43.014748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:43.021822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:43.022303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:43.022742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:43.023426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:43.023879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:43.024301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:43.053238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-64a1232f-45bd-41bd-84ef-1dc84011423e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Aug 08 17:17:43.053800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 734/1407] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:43.743783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:43.744398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:43.751479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:43.751966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:43.752402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:43.753087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:43.753538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:43.753989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:43.818695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:43.826134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-33993f33-a184-4922-8c4b-81fa38b0f105 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086137 Aug 08 17:17:43.826692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 674/1408] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:44.067042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:44.069236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:44.075592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:44.076087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:44.076530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:44.077255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:44.077718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:44.078175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:44.106830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8490759b-4f2f-45e9-bb91-f4aefee42098 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 Aug 08 17:17:44.107372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 735/1409] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:44.847822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:44.848347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:44.854864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:44.855349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:44.855790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:44.856484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:44.856949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:44.857379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:44.917018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:44.924382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce5a45fd-9c56-4f89-90d8-71abdfa02d9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080532 Aug 08 17:17:44.924935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 675/1410] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:45.119589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:45.121730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:45.128856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:45.129381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:45.129853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:45.130557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:45.131021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:45.131485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:45.159726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ddbb541f-6d0a-41fb-a15a-865a0f591049 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Aug 08 17:17:45.160271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 736/1411] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:45.944988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:45.945534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:45.952035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:45.952507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:45.952938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:45.953614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:45.954090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:45.954513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:46.013678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:46.021284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a073690f-f6e6-4427-80ea-d9e09a5beb7b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080252 Aug 08 17:17:46.021858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 676/1412] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:46.171869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:46.174650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:46.180769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:46.181376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:46.181852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:46.182551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:46.183007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:46.183435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:46.187276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:46.212055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eaae8e49-57f5-4ce8-861d-cc69f9002181 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Aug 08 17:17:46.212533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 737/1413] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:47.042107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:47.042722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:47.048673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:47.049151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:47.049588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:47.050295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:47.050749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:47.051174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:47.112451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:47.119947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0e7da41e-ccc9-409b-8e55-e695e76cd7a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081967 Aug 08 17:17:47.120500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 677/1414] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:47.223999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:47.226203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:47.232871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:47.233350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:47.233803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:47.234980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:47.235431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:47.235851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:47.263772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-90ec7e00-de74-47b1-947d-597826fd8468 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 08 17:17:47.264305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 738/1415] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:48.141164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:48.141779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:48.149493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:48.150021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:48.150455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:48.151136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:48.151589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:48.152009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:48.215920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:48.224136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-86d5ba60-b844-45e8-9d43-ee27456ecb08 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087375 Aug 08 17:17:48.224699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 678/1416] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:48.275996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:48.278197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:48.285124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:48.285642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:48.286111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:48.286807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:48.287265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:48.287696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:48.315510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-23274cf0-d97d-463e-bca2-6eac4034def3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043411 Aug 08 17:17:48.316050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 739/1417] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:49.244720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:49.245328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:49.252412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:49.252895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:49.253323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:49.254027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:49.254478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:49.254892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:49.315310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:49.322700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-78874bfa-c32a-4476-ba66-98113cd18b9a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082044 Aug 08 17:17:49.323544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 679/1418] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:49.326780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:49.329514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:49.335941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:49.336423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:49.336864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:49.337583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:49.338070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:49.338499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:49.366151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c670970a-fbf6-4cae-81b5-76c6609177c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 08 17:17:49.366697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 740/1419] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:17:50.344431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:50.344999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:50.351460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:50.351935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:50.352363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:50.353039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:50.353483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:50.353927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:50.377324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:50.379645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:50.386053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:50.386541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:50.386974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:50.387664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:50.388113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:50.388533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:50.414181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:50.418508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62613598-7b30-4052-bdc5-dfe06aa0aaa8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Aug 08 17:17:50.419064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 741/1420] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:17:50.422018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9e94f8b-2435-4bd9-9edc-4ea5b0a92c1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082049 Aug 08 17:17:50.422761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 680/1421] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:51.430400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:51.432555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:51.438988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:51.439468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:51.439907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:51.440602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:51.441063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:51.441495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:51.442436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:51.443049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:51.449338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:51.449874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:51.450308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:51.450997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:51.451470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:51.451890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:51.470783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-acf7a7e5-9d4f-4752-a4cd-b78f434f7cf0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 Aug 08 17:17:51.471356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 742/1422] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:51.511858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:51.519483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a84af963-0e7e-4cb2-8b13-c5ebfc68e108 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080640 Aug 08 17:17:51.520041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 681/1423] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:17:52.482949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:52.485190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:52.491491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:52.491970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:52.492407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:52.493088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:52.493539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:52.494064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:52.523191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-997b42ee-9362-47ed-a8cf-c591ab7676c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Aug 08 17:17:52.524007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 743/1424] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:17:52.540406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:52.541020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:52.547740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:52.548222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:52.548656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:52.549373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:52.549854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:52.550276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:52.614706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:52.622206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-701ccf86-da02-424b-a314-6f61f8c9403e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085615 Aug 08 17:17:52.622761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 682/1425] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:53.536348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:53.538536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:53.544912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:53.545403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:53.545869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:53.546566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:53.547026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:53.547457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:53.576425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1842a428-7c69-4d0d-864b-433e3cd40d89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Aug 08 17:17:53.576993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 744/1426] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:53.643322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:53.643940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:53.650598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:53.651081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:53.651518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:53.652206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:53.652660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:53.653086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:53.715315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:53.723285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f33e90b9-476b-4407-9662-72afa3726a9c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084441 Aug 08 17:17:53.723848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 683/1427] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:54.588630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:54.590869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:54.597340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:54.597845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:54.598282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:54.599012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:54.599446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:54.599862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:54.628216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7d26ea7d-20a3-4da6-b6c0-e9a36c7a7765 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Aug 08 17:17:54.628758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 745/1428] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:54.743605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:54.744215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:54.750671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:54.751706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:54.752141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:54.752832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:54.753288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:54.753708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:54.771197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:54.812623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:54.820514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b83d32b4-ecdf-480e-bb41-2b152b45bd8c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080785 Aug 08 17:17:54.821059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 684/1429] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:55.640693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:55.643383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:55.645957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=48 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:17:55.650634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:55.651127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:55.651572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:55.652300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:55.652779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:55.653214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:55.682633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3e75e9c3-1d88-422d-b071-c70beea4a661 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Aug 08 17:17:55.683181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 746/1430] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:55.840531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:55.841060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:55.847521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:55.848002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:55.848437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:55.849121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:55.849572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:55.850018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:55.910491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:55.917946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6edbbc66-aae7-4cb9-89b4-411539455cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081315 Aug 08 17:17:55.918502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 685/1431] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:56.695489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:56.697642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:56.704607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:56.705089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:56.705530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:56.706249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:56.706705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:56.707129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:56.735210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02666fa1-1c4c-4094-9aa2-e7481b17b64e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Aug 08 17:17:56.735764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 747/1432] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:56.937935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:56.938554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:56.944871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:56.945350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:56.945811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:56.946497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:56.946953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:56.947378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:57.009975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:57.018094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19d25516-3ef3-41c2-a790-2ec4612cb90b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083988 Aug 08 17:17:57.018666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 686/1433] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:57.746647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:57.748774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:57.755761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:57.756240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:57.756674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:57.757354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:57.757827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:57.758253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:57.786849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c3476eb8-10c1-4340-aa3d-1bc93a978d95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Aug 08 17:17:57.787397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 748/1434] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:58.039178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:58.039792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:58.046155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:58.046633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:58.047065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:58.047770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:58.048222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:58.048644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:58.108673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:58.116107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-97307188-84f8-4cd4-b7f9-261a84035cd3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080771 Aug 08 17:17:58.116654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 687/1435] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:58.799193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:58.801404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:58.807823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:58.808305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:58.808738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:58.809418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:58.809907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:58.810322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:58.838276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0cb94baa-221f-4ad7-8bf7-a83787423747 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Aug 08 17:17:58.838865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 749/1436] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:17:59.136976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:59.137535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:59.144165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:59.144642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:59.145070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:59.145748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:59.146219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:59.146636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:59.206746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:17:59.214130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c47987a0-a4fd-417c-a331-edbdb2ccd4ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080975 Aug 08 17:17:59.214683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 688/1437] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:17:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:17:59.850302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:17:59.852463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:17:59.858918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:59.859395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:59.859848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:59.861076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:17:59.861549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:17:59.862010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:17:59.889538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-241cae26-4118-42d3-bbc9-38a94e3a39da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Aug 08 17:17:59.890115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 750/1438] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:17:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:00.235183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:00.235824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:00.242342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:00.242820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:00.243256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:00.243939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:00.244390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:00.244812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:00.304776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:00.312204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2874408-a293-4489-8c12-db466e66d137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080924 Aug 08 17:18:00.312757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 689/1439] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:00.902122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:00.904213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:00.910808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:00.911298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:00.911768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:00.912465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:00.912924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:00.913349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:00.942627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2db282ef-5544-4d9a-97ef-a8645b6815ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Aug 08 17:18:00.943182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 751/1440] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:01.333109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:01.333726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:01.340190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:01.340672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:01.341107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:01.341805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:01.342269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:01.342693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:01.407478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:01.414942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77375618-5853-4d23-8611-9b03000dfe78 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086366 Aug 08 17:18:01.415497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 690/1441] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:01.954880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:01.956949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:01.963294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:01.963890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:01.964221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:01.964942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:01.965395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:01.965840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:01.994817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-df9fce10-9577-42e8-92fc-545f1bb0a58d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Aug 08 17:18:01.995430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 752/1442] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:02.435881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:02.436492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:02.442856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:02.443337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:02.443770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:02.444447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:02.444898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:02.445318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:02.505624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:02.513200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-356c0358-4c75-45f9-a27b-8decc91d8501 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081198 Aug 08 17:18:02.513836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 691/1443] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:03.007029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:03.009218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:03.015636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:03.016113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:03.016549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:03.017735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:03.018216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:03.018640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:03.043036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:03.047378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ee52d64c-f648-4d7c-a97b-a9aaacc1783d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Aug 08 17:18:03.053974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 753/1444] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:03.534272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:03.534876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:03.541254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:03.541734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:03.542204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:03.542891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:03.543345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:03.543766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:03.604357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:03.612174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f26b179f-c21d-4196-a3ef-05b8c9200703 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081749 Aug 08 17:18:03.612745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 692/1445] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:04.059400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:04.061614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:04.068406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:04.068896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:04.069341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:04.070064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:04.070529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:04.070988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:04.099286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-70125ea8-a11f-406a-a235-af594cf3dd4c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Aug 08 17:18:04.099830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 754/1446] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:04.632516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:04.633128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:04.635487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=51 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:04.640146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:04.640632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:04.641062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:04.641748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:04.642716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:04.643141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:04.703722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:04.711855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76c12bf8-2af4-424a-b0aa-3a5bb881ffea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083247 Aug 08 17:18:04.712411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 693/1447] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:05.111327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:05.113529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:05.119869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:05.120355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:05.120795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:05.121486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:05.121974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:05.122404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:05.151674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-616de3dc-1e9a-49c6-874b-a2ffb3715957 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 08 17:18:05.152230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 755/1448] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:05.732016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:05.732625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:05.739619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:05.740095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:05.740527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:05.741215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:05.741664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:05.742215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:05.805416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:05.812951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15db99ef-ccfc-4c3e-bb60-c88ea3297c8d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084791 Aug 08 17:18:05.813494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 694/1449] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:06.163953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:06.166141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:06.172464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:06.172942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:06.173906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:06.174591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:06.175053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:06.175459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:06.204305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e4a9670a-953d-4bae-a2cc-287b5d8f4707 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 08 17:18:06.204855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 756/1450] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:06.833502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:06.834152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:06.840652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:06.841082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:06.841519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:06.842230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:06.842690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:06.843112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:06.902683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:06.910641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb2ee99e-45a1-4fd8-85e5-d903013be5b3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081456 Aug 08 17:18:06.911194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 695/1451] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:07.216525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:07.218693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:07.224981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:07.225466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:07.225933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:07.226614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:07.227063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:07.227485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:07.255462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0199f131-98b2-4cfb-b1be-6bfd403e0c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 08 17:18:07.256000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 757/1452] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:07.930888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:07.931422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:07.937839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:07.938325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:07.938792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:07.939483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:07.939940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:07.940365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:08.002655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:08.010189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-049f0316-0429-470f-b2ae-59a70e4b8458 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083196 Aug 08 17:18:08.010750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 696/1453] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:08.268121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:08.270610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:08.277045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:08.277535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:08.278018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:08.278715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:08.279176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:08.279606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:08.309839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8c53fad8-7cb7-4360-b291-d12cd3df8002 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Aug 08 17:18:08.310743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 758/1454] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:09.030854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:09.031472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:09.038472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:09.038954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:09.039385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:09.040067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:09.040520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:09.040942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:09.099974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:09.107536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54e9124a-bcd9-42be-b03c-66aff27f7e8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080481 Aug 08 17:18:09.108084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 697/1455] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:09.321740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:09.323930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:09.330826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:09.331300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:09.331737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:09.332417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:09.332905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:09.333324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:09.360855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f6ca96a8-7f5e-4e73-b318-eedfe4d4e25d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Aug 08 17:18:09.361386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 759/1456] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:10.128100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:10.128799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:10.135203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:10.135686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:10.136125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:10.136810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:10.137264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:10.137686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:10.200755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:10.208202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6270270e-266b-47e4-974b-c6c17c10bafb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083961 Aug 08 17:18:10.208762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 698/1457] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:10.372846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:10.374975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:10.381971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:10.382533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:10.383030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:10.383729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:10.384194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:10.384623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:10.414319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6fb6c82b-201a-4662-85ac-5d110c642d8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Aug 08 17:18:10.414946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 760/1458] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:11.229254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:11.229900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:11.236451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:11.236943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:11.237379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:11.238112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:11.238566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:11.238990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:11.299399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:11.306793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9df5c1e-c79d-40cd-83ea-2c21f17836f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081467 Aug 08 17:18:11.307351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 699/1459] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:11.425574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:11.427805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:11.434190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:11.434680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:11.435126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:11.435819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:11.436281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:11.436713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:11.464883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87e49074-a063-4e6c-bd09-e58632afd5a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Aug 08 17:18:11.465426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 761/1460] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:12.327524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:12.328161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:12.334611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:12.336094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:12.336562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:12.337252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:12.337705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:12.338155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:12.398215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:12.405607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce210b59-087b-4b02-8cb2-f2e93a1fd496 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081923 Aug 08 17:18:12.406194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 700/1461] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:12.477018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:12.479192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:12.486186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:12.486671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:12.487124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:12.487808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:12.488261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:12.488688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:12.516532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-17973338-82b3-427e-a485-7f9a5dcc3bf1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Aug 08 17:18:12.517076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 762/1462] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:13.426357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:13.426976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:13.433370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:13.433876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:13.434316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:13.434999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:13.435461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:13.435882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:13.440460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:13.495480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:13.503525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-67b76e44-cc0d-435e-88c7-3357fa6c4ee8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081522 Aug 08 17:18:13.504084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 701/1463] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:13.528443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:13.530650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:13.536914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:13.537394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:13.537856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:13.538535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:13.538990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:13.539436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:13.568062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e0b71f0a-aae3-40a0-94d3-99b461de090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Aug 08 17:18:13.568597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 763/1464] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:14.524275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:14.524876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:14.531716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:14.532863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:14.533237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:14.533975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:14.534432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:14.534858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:14.581159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:14.586498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:14.595930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:14.596728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:14.597248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:14.598096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:14.598623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:14.599117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:14.603013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:14.611145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f02d8b1-5795-44de-9839-8ec92af9ef17 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.090739 Aug 08 17:18:14.613157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 702/1465] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:14.631213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-da7b14f8-4e73-4dc1-aaca-346da09e528f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054724 Aug 08 17:18:14.631781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 764/1466] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:15.632205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:15.632854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:15.639352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:15.639832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:15.640270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:15.640967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:15.641418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:15.641865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:15.644212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:15.646461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:15.652318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:15.652809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:15.653248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:15.653982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:15.654441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:15.654899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:15.683829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02df5d20-475f-4ec2-8582-aa3e3012bf55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 08 17:18:15.684389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 765/1467] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:18:15.705072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:15.712442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5091b769-531f-4c49-a050-462f94defe6c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084155 Aug 08 17:18:15.712999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 703/1468] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:16.696355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:16.698526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:16.704801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:16.705280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:16.705714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:16.706419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:16.706867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:16.707287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:16.732528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:16.733138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:16.734944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d4f85087-8bbe-428c-9f46-94d0f1921f53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Aug 08 17:18:16.735492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 766/1469] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:16.739826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:16.740306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:16.740735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:16.741419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:16.741895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:16.742311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:16.802364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:16.809711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53f6ea6f-13eb-47d2-91fd-80bf2eb1c4b5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080992 Aug 08 17:18:16.810298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 704/1470] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:18:17.747786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:17.749980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:17.756365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:17.756842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:17.757276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:17.757985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:17.758438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:17.758858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:17.786983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11dac0f3-5c8c-4d41-848c-211b9a47c4db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Aug 08 17:18:17.787511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 767/1471] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:17.830521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:17.831124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:17.837486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:17.837999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:17.838479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:17.839110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:17.839559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:17.839978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:17.899971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:17.907378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-457ad2c7-4239-4a22-85a8-2c87f228b069 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080693 Aug 08 17:18:17.908656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 705/1472] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:18.799603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:18.801757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:18.808153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:18.808633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:18.809068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:18.809777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:18.810251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:18.810671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:18.839608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-70b0b95c-6bea-4c8e-b165-fe02b191ccf3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Aug 08 17:18:18.840097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 768/1473] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:18.928764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:18.929433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:18.935914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:18.936401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:18.936842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:18.937535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:18.938018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:18.938445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:19.002545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:19.010215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c78a8f9-0794-41d2-8a06-782f3dc3d604 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085268 Aug 08 17:18:19.010773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 706/1474] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:19.851716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:19.853952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:19.860411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:19.860892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:19.861328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:19.862036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:19.862488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:19.863220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:19.891599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f28ea499-5896-432d-b070-768534f68e3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 08 17:18:19.892779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 769/1475] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:20.031281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:20.031895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:20.038305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:20.038785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:20.039223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:20.039915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:20.040367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:20.040792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:20.100217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:20.107638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d253c6b2-f66a-4cfa-aa54-6cc27d6ae871 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080134 Aug 08 17:18:20.108119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 707/1476] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:20.904656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:20.906856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:20.913967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:20.914455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:20.914891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:20.915576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:20.916026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:20.916446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:20.932993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:20.945431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c2efe6c8-3520-4a94-bf4c-ba757962649e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Aug 08 17:18:20.946044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 770/1477] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:21.127941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:21.128945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:21.135000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:21.135478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:21.135914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:21.136599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:21.137075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:21.137495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:21.197752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:21.205652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5d3ce3f0-b194-4eac-ab70-c3792e3bbcb2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081585 Aug 08 17:18:21.206245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 708/1478] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:21.956689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:21.958790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:21.965472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:21.966005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:21.966448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:21.967136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:21.967593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:21.968050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:21.998196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ef5f3bc7-de5d-40dd-8c46-37d068d3db0b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 08 17:18:21.998753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 771/1479] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:22.226932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:22.227547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:22.233958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:22.234430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:22.234859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:22.235537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:22.236544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:22.236969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:22.298458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:22.306389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a3a496e6-897f-499a-9d8a-39960c867978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083357 Aug 08 17:18:22.306943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 709/1480] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:23.010353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:23.012551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:23.019837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:23.020322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:23.020763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:23.021459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:23.021968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:23.022400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:23.049888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-145e92d6-4541-44ea-a90e-52ccf269ff33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Aug 08 17:18:23.050425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 772/1481] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:23.327573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:23.328131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:23.334530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:23.335010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:23.335440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:23.336127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:23.336575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:23.336993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:23.402110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:23.409620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6d93ba27-acbe-4fe1-a387-a13dff3360e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085987 Aug 08 17:18:23.410251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 710/1482] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:24.062007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:24.064185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:24.070492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:24.070977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:24.071400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:24.072080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:24.072529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:24.072949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:24.101886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1b25441b-669b-4718-85eb-da95e1f534b8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 08 17:18:24.102428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 773/1483] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:24.430281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:24.430827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:24.437413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:24.437926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:24.438368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:24.441252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:24.441715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:24.442161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:24.502219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:24.509532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-66f336ac-bff2-4964-a65e-43695cbef67e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083633 Aug 08 17:18:24.510114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 711/1484] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:25.114889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:25.117078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:25.123442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:25.123927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:25.124369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:25.125062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:25.125515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:25.125970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:25.154274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd83c66c-e32e-4603-b5f1-6e996298eeb1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 08 17:18:25.154816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 774/1485] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:25.530899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:25.531515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:25.538588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:25.539070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:25.539509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:25.540229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:25.540686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:25.541112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:25.600861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:25.608299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c8c07f3-883d-487a-92d5-f3dd3028c3de tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081223 Aug 08 17:18:25.608854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 712/1486] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:26.166813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:26.168986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:26.171280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=58 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:26.176349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:26.176826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:26.177261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:26.177971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:26.178424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:26.178846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:26.207163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-26facced-df81-4ccf-bef7-4dc1a45bd278 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Aug 08 17:18:26.207698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 775/1487] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:26.628427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:26.629041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:26.635413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:26.635890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:26.636328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:26.637017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:26.637466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:26.637918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:26.697257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:26.704667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d729a60-dd95-4a16-b6f2-354e48d4cd3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080079 Aug 08 17:18:26.705223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 713/1488] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:27.219240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:27.222037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:27.228737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:27.229226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:27.229667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:27.230391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:27.230847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:27.231275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:27.259498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0f6d3541-c4bd-4ac1-88c7-0c91d328d51e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Aug 08 17:18:27.260036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 776/1489] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:27.724955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:27.725573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:27.732080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:27.732570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:27.733013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:27.733706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:27.734193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:27.734620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:27.797069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:27.805050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-afd75720-24fe-4907-9747-09e300a7329f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083978 Aug 08 17:18:27.805615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 714/1490] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:28.271720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:28.273958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:28.280496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:28.280976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:28.281413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:28.282119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:28.283184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:28.283606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:28.312112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c7826f1b-b77c-4119-a0ba-d6e045cb4c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Aug 08 17:18:28.312688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 777/1491] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:28.826416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:28.827032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:28.834181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:28.834662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:28.835102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:28.835789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:28.836244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:28.836669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:28.896536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:28.903904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-531023ed-7bf1-4aea-96e4-ea71c24b8554 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081324 Aug 08 17:18:28.904462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 715/1492] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:29.324173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:29.326409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:29.332833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:29.333321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:29.333769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:29.334489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:29.334950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:29.335384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:29.363801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2d46f370-45e5-4215-b5b3-e849b6b9292d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Aug 08 17:18:29.364338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 778/1493] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:29.924515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:29.925071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:29.931505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:29.931988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:29.932424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:29.933109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:29.933567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:29.934024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:29.995650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:30.003029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35b6db20-0c8d-4d8a-a58d-6366ec6a5ee2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082513 Aug 08 17:18:30.003602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 716/1494] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:30.376035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:30.378716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:30.385128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:30.385607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:30.386068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:30.386756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:30.387205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:30.387630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:30.416168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b927fb1-4915-438a-94ed-6d193474548e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Aug 08 17:18:30.416704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 779/1495] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:31.023391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:31.024000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:31.030359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:31.030832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:31.031261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:31.031942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:31.032387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:31.032803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:31.091640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:31.094922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:31.099644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-97f5a76b-410d-4b49-9ad1-14ef07a333f0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080131 Aug 08 17:18:31.100202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 717/1496] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:31.428498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:31.430693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:31.437209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:31.437691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:31.438163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:31.438887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:31.439485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:31.439908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:31.468988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cf0aa121-5153-4216-be72-ad7e0922a0c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 08 17:18:31.469540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 780/1497] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:32.127683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:32.128908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:32.136121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:32.136595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:32.137181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:32.137806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:32.138264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:32.138684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:32.203061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:32.210916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f6991ff8-9aac-49c4-8714-74bbcc7061d9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087149 Aug 08 17:18:32.211467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 718/1498] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:32.481468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:32.483713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:32.490740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:32.491227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:32.491674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:32.492369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:32.492830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:32.493260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:32.521845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-77570793-0693-4672-8c0a-84b9ddcd1246 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Aug 08 17:18:32.522420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 781/1499] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:33.231946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:33.232558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:33.239208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:33.239692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:33.240147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:33.240869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:33.241323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:33.241749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:33.302203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:33.309468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c4b3084f-8924-48b3-bab1-f75934a8c282 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081550 Aug 08 17:18:33.310065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 719/1500] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:33.533128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:33.535266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:33.541600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:33.542128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:33.542569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:33.543261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:33.543717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:33.544143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:33.572302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ed321100-b17c-49d7-9203-2f2c7a1cbae3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Aug 08 17:18:33.572854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 782/1501] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:34.330259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:34.330875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:34.337816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:34.338376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:34.338815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:34.339505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:34.339960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:34.340385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:34.403900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:34.412873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d37af4dc-a6da-481d-9f47-efd852bdc981 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086383 Aug 08 17:18:34.415025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 720/1502] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:34 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:34.585443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:34.587628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:34.594041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:34.594522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:34.594957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:34.595652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:34.596098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:34.596521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:34.627031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-433a94f2-4d9c-41b1-aa72-07f9d6d7ab54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Aug 08 17:18:34.627572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 783/1503] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:35.439886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:35.440498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:35.443489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:35.448128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:35.448606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:35.449040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:35.449721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:35.450194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:35.450621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:35.511967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:35.519666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-83557b61-32c6-4ac6-9ded-daf63185faeb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083896 Aug 08 17:18:35.520223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 721/1504] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:35.639180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:35.641464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:35.648183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:35.648669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:35.649112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:35.649827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:35.650291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:35.650717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:35.680631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-69ce1bed-d662-4fa3-b9b0-ab7976fe19d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Aug 08 17:18:35.681185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 784/1505] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:36.539553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:36.540167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:36.546615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:36.547097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:36.547532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:36.548219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:36.548674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:36.549096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:36.613201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:36.621020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b0820a5-2c06-488c-8ab2-bba5b13b300d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085280 Aug 08 17:18:36.621588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 722/1506] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:18:36.693345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:36.695532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:36.702033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:36.702513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:36.702950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:36.703633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:36.704086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:36.704510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:36.732015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-41a77d51-3e32-4b4a-b488-87b769fc8eae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Aug 08 17:18:36.732547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 785/1507] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:37.744157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:37.746425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:37.754388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:37.754873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:37.755288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:37.755721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:37.755912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:37.756027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:37.756484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:37.756904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:37.761719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:37.762250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:37.762684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:37.763405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:37.763859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:37.764286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:37.785899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-af7b7faa-cd78-41ab-a8e5-fc3e999dfc30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 08 17:18:37.786453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 786/1508] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:18:37.826398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:37.834181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2498a14e-5c13-45b8-96f7-bee778fc6abf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.195707 Aug 08 17:18:37.834736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 723/1509] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:38.798101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:38.800891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:38.807481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:38.807975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:38.808420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:38.809117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:38.809579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:38.810038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:38.813757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:38.838954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62edfcc0-2747-41e0-9825-7111a0e29234 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Aug 08 17:18:38.839432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 787/1510] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:38.854374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:38.854992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:38.861425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:38.861937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:38.862407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:38.863091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:38.863550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:38.863972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:38.924109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:38.931844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8bfabc94-3369-4300-ab14-857d97858c33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081282 Aug 08 17:18:38.932405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 724/1511] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:39.831264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:18:39.831483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:18:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:18:39.851081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:39.853160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:39.860115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:39.860597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:39.861044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:39.861737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:39.862718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:39.863146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:39.891354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9857a4e2-c227-4cad-a399-8bd3d9983a42 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Aug 08 17:18:39.891893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 788/1512] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:39.953020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:39.953629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:39.960389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:39.960867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:39.961299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:39.962006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:39.962454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:39.962871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:40.023123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:40.030442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b546516f-9c71-4e04-9a94-5ce69f86412d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081247 Aug 08 17:18:40.030992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 725/1513] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:40.903947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:40.906082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:40.912364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:40.912849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:40.913289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:40.914006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:40.914469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:40.914899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:40.942962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3c499372-00ad-42e4-b1ef-55915d61a20f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Aug 08 17:18:40.943507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 789/1514] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:41.051780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:41.052394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:41.058715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:41.059193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:41.059626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:41.060305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:41.060764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:41.061179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:41.123593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:41.132101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4ea80b6-d57f-4e7b-a50d-96ae1311d2a2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084149 Aug 08 17:18:41.132645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 726/1515] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:41.955325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:41.957986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:41.964418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:41.964909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:41.965350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:41.966142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:41.966606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:41.967033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:41.995167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-986ab4c5-5052-49aa-b7c4-5f27cee8a8db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 08 17:18:41.995879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 790/1516] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:42.162592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:42.163237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:42.169924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:42.170416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:42.170854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:42.171552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:42.172033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:42.172483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:42.233759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:42.241548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c2dafe2-7ccd-45da-a4c4-5af0eabfec2c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083617 Aug 08 17:18:42.242137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 727/1517] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:43.007937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:43.010153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:43.016500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:43.016978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:43.017661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:43.018929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:43.019400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:43.019851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:43.047406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-efa5ac09-13c6-4dde-91be-ba3d875e7010 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 08 17:18:43.047942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 791/1518] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:43.263475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:43.264122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:43.271397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:43.271896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:43.272315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:43.273002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:43.273458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:43.273925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:43.333267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:43.340651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27c1d515-0916-4775-990f-21c5ed4b326f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081145 Aug 08 17:18:43.341207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 728/1519] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:44.059619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:44.061827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:44.068640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:44.069119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:44.069553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:44.070266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:44.070716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:44.071135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:44.099913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7413da7d-22ca-4cf5-9660-331955654cd1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 08 17:18:44.100465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 792/1520] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:44.360552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:44.361062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:44.367988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:44.370937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:44.370937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:44.370937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:44.370937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:44.371318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:44.432968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:44.441019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2aa11a21-12f0-46bc-aa0a-1d26f9dea683 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083828 Aug 08 17:18:44.441570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 729/1521] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:45.112003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:45.114251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:45.120590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:45.121071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:45.121541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:45.122290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:45.122741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:45.123174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:45.152330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2c7aea7a-d939-4a64-bcf3-85feb4d92913 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Aug 08 17:18:45.152879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 793/1522] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:45.461150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:45.461673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:45.468042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:45.468522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:45.468960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:45.469647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:45.470126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:45.473595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:45.532833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:45.540385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-61440a0a-8fe1-436e-b9a9-363f11006502 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083231 Aug 08 17:18:45.540955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 730/1523] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:46.164906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:46.167079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:46.173185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:46.173664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:46.174133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:46.175438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:46.175889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:46.176310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:46.203806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4a4953c2-087e-482a-a732-07731637b990 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 Aug 08 17:18:46.204341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 794/1524] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:46.560651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:46.561259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:46.567172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:46.567649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:46.568083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:46.568756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:46.569204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:46.569632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:46.629380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:46.636771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8fdd0843-fb12-4bf7-a260-cf48be2012f2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080166 Aug 08 17:18:46.637319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 731/1525] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:47.215972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:47.218061 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:47.224315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:47.224796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:47.225230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:47.225944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:47.226395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:47.226818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:47.256208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9761d105-59ad-465e-8eeb-5c97bd7a784d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Aug 08 17:18:47.256755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 795/1526] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:47.658129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:47.658734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:47.666310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:47.666815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:47.667247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:47.667926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:47.668376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:47.668798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:47.728506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:47.735816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a6cbb6d1-fb63-4089-82f0-5a5a2a5b7861 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081550 Aug 08 17:18:47.736362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 732/1527] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:48.268489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:48.271237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:48.277770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:48.278276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:48.278712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:48.279397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:48.279850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:48.280271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:48.307776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-868471ea-0a29-4ebe-9fbb-a704cadb3353 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Aug 08 17:18:48.308315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 796/1528] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:48.757268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:48.757909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:48.764252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:48.764732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:48.765172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:48.765885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:48.766340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:48.766764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:48.828221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:48.835661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-39eb55d5-ea4b-426e-a5fe-3974684ca0dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082958 Aug 08 17:18:48.836215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 733/1529] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:49.319891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:49.322105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:49.328915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:49.329415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:49.329892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:49.330590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:49.331050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:49.331972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:49.360623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-670292b1-8f64-4884-b68e-08f04075e4a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Aug 08 17:18:49.361180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 797/1530] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:49.856278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:49.856818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:49.863300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:49.863781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:49.864216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:49.864897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:49.865351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:49.865775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:49.883600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:49.928542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:49.935994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-22be9540-7117-4d93-bb96-3762fdbe7a1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083694 Aug 08 17:18:49.936555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 734/1531] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:50.372715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:50.374883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:50.381808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:50.382280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:50.382717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:50.383402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:50.383853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:50.384276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:50.411993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3cd9501f-ca47-48ca-9bee-2a1b48af1d07 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Aug 08 17:18:50.412532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 798/1532] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:50.957138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:50.957768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:50.964223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:50.964708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:50.965152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:50.965870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:50.966333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:50.966758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:51.027011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:51.034402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84540135-300f-4002-a78e-374940feac4b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081726 Aug 08 17:18:51.035538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 735/1533] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:51.423703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:51.425942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:51.432337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:51.432813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:51.433245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:51.433963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:51.434413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:51.434831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:51.464624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8d95f939-9fc3-465b-b91c-224cf6304e69 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Aug 08 17:18:51.465184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 799/1534] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:52.055265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:52.055876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:52.062357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:52.062833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:52.063262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:52.063941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:52.064389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:52.064806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:52.126608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:52.141561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21a1f42b-ba55-4ce4-ac71-6d03c2ee7ba3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083853 Aug 08 17:18:52.141561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 736/1535] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:52.477403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:52.479558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:52.485993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:52.486472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:52.486908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:52.487595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:52.488045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:52.488465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:52.516338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9604504d-b4f4-4ba7-887f-7612cb19c16c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042825 Aug 08 17:18:52.517129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 800/1536] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:53.155023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:53.155628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:53.162071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:53.162545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:53.162977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:53.163645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:53.164129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:53.164547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:53.224481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:53.231903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f60f5f8-f0b1-4026-841b-8d74d4185bfd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080702 Aug 08 17:18:53.232459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 737/1537] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:53.528459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:53.530721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:53.537466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:53.537994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:53.538430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:53.539115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:53.539569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:53.539989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:53.568429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e8c0d254-e560-489d-b695-cd871b74f9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Aug 08 17:18:53.568962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 801/1538] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:54.253641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:54.254303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:54.260726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:54.261214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:54.261653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:54.262382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:54.262858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:54.263284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:54.326227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:54.334418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b7dd20f3-afc4-44e0-b585-6cd86d8515eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085529 Aug 08 17:18:54.334977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 738/1539] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:54.580538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:54.582741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:54.589146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:54.589825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:54.590103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:54.590805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:54.591257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:54.591691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:54.620209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ca2a4197-ced8-411d-b88e-aa17b9182b5c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Aug 08 17:18:54.620764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 802/1540] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:55.355082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:55.355691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:55.362104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:55.363085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:55.363512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:55.364218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:55.364665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:55.365126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:55.425672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:55.433012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f36b122-5225-4826-921c-ed4aac4fc137 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081884 Aug 08 17:18:55.433567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 739/1541] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:55.632940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:55.635135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:55.641510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:55.642295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:55.642738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:55.643427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:55.643881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:55.644308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:55.668085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:55.672437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-82887041-683a-4c0f-adaf-e61e4ceac23e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Aug 08 17:18:55.672994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 803/1542] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:56.454263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:56.454840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:56.461814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:56.462304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:56.462735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:56.463412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:56.463859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:56.464278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:56.524792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:56.532283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3d10fcfb-5fa2-40eb-8173-8706a2c83c3a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082210 Aug 08 17:18:56.532827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 740/1543] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:56.692315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:56.694496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:56.700936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:56.701415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:56.701885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:56.702567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:56.703017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:56.703466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:56.732378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a05a18a5-c3fc-4af2-a168-80a6a5f4d567 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Aug 08 17:18:56.732918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 804/1544] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:57.552840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:57.553449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:57.559813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:57.560291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:57.560720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:57.561397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:57.561876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:57.562297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:57.621858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:57.629250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8caf3bf9-8d68-464d-85a9-4c2ef2b9619d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080930 Aug 08 17:18:57.629826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 741/1545] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:57.744265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:57.746477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:57.748782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=60 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:18:57.753358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:57.753861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:57.754419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:57.755107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:57.755556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:57.755976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:57.785741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e3fdd32b-85f7-44ec-abc5-3105022de573 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 08 17:18:57.786297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 805/1546] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:58.650074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:58.650718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:58.656977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:58.657457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:58.657931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:58.658628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:58.659083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:58.659507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:58.724539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:18:58.732117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-20051a51-b674-449b-8417-c5d1d4d78301 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086011 Aug 08 17:18:58.732675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 742/1547] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:18:58.798040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:58.800255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:58.806582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:58.807073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:58.807518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:58.808229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:58.808690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:58.809123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:58.838136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b18d1660-add7-49d3-8670-32e4afaf17e7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Aug 08 17:18:58.838679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 806/1548] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:18:59.753358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:59.754016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:59.760348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:59.760822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:59.761254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:59.761962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:59.762412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:59.762831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:59.851205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:18:59.853564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:18:59.860229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:59.860721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:59.861161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:59.861898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:18:59.862356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:18:59.862780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:18:59.894596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c5b06bb5-45fa-4f30-8e47-97abb6a7bc6b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Aug 08 17:18:59.895176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 807/1549] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:18:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:00.038341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:00.045907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-576d0242-cd29-4f4d-9200-9c210b76cc4e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.296442 Aug 08 17:19:00.046463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 743/1550] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:18:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:00.906784 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:00.908827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:00.915174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:00.915669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:00.916097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:00.916783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:00.917236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:00.917662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:00.946552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d26e1199-a2b8-4696-8d3b-eaa2a7d2a637 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Aug 08 17:19:00.947098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 808/1551] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:01.066145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:01.066759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:01.073041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:01.073514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:01.073983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:01.074661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:01.075110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:01.075528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:01.138751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:01.146497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-156296fd-490d-406e-8648-6903d325080f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084142 Aug 08 17:19:01.155922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 744/1552] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:01.959339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:01.961403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:01.967788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:01.968266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:01.968702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:01.969388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:01.969878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:01.970304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:01.997908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0b058cf2-8601-4793-9615-766bae474f30 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Aug 08 17:19:01.998450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 809/1553] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:02.176245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:02.176852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:02.183179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:02.183654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:02.184092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:02.184766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:02.185214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:02.185634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:02.247031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:02.255331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2fab2553-d3cc-4036-a9ce-61ba3a3071db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083402 Aug 08 17:19:02.255893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 745/1554] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:03.010080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:03.012217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:03.019419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:03.019902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:03.020372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:03.021091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:03.021564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:03.021998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:03.050970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-77c96034-b77c-4b0e-82be-68815f5c6f50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044849 Aug 08 17:19:03.051523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 810/1555] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:03.275947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:03.276485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:03.283137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:03.283621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:03.284102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:03.284784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:03.285233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:03.285655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:03.345139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:03.352573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b7f25b6a-a7cf-4bac-9227-541ea69a4419 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080642 Aug 08 17:19:03.353131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 746/1556] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:04.063133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:04.065816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:04.072163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:04.072650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:04.073092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:04.073797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:04.074260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:04.074687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:04.102909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3a30e1d6-452f-4104-86aa-ab594a2e406e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 08 17:19:04.103674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 811/1557] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:04.374240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:04.374785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:04.382155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:04.382649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:04.383120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:04.383856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:04.384344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:04.384780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:04.448502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:04.456155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-48bdaa9c-5213-4057-b82c-efeba7145f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087065 Aug 08 17:19:04.456717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 747/1558] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:05.114976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:05.117106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:05.123431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:05.123908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:05.124341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:05.125024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:05.125475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:05.125923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:05.154055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-75c536a0-1bff-4a45-8e6a-06043a1dff0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 Aug 08 17:19:05.154553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 812/1559] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:05.476779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:05.477393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:05.483702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:05.484178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:05.484609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:05.485285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:05.485733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:05.486179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:05.545836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:05.553186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bbb7b0e2-1d1a-4b01-8a70-cf14cbe5d114 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080315 Aug 08 17:19:05.553732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 748/1560] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:06.165711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:06.167875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:06.174233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:06.175212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:06.175648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:06.176342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:06.176798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:06.177224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:06.205449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11df84af-f7ce-40de-8262-878a26adbda1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Aug 08 17:19:06.206030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 813/1561] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:06.574510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:06.575122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:06.577440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:06.582621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:06.583079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:06.583521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:06.584217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:06.584671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:06.585096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:06.650133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:06.657625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54b943a8-dcdc-4a27-be6a-b0438fece549 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087067 Aug 08 17:19:06.658209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 749/1562] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:07.217591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:07.219752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:07.226089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:07.226570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:07.227007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:07.227690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:07.228168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:07.228590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:07.256450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-241ba9a7-8e15-4223-a7dc-2f05421ef47c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Aug 08 17:19:07.256993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 814/1563] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:07.679265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:07.679876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:07.686233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:07.686715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:07.687149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:07.687836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:07.688285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:07.688707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:07.750135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:07.757713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f6968da-92fe-458f-854b-c617768fb37d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082385 Aug 08 17:19:07.758311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 750/1564] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:08.269618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:08.271894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:08.278264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:08.278747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:08.279186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:08.279875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:08.280330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:08.280761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:08.309020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a5b532f8-cb9c-46ef-b62e-9bf329d7c5f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Aug 08 17:19:08.309557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 815/1565] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:08.778323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:08.778928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:08.786437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:08.786910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:08.787433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:08.788386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:08.789184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:08.790323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:08.794669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:08.853513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:08.860872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-98f22829-46ca-436b-a183-2324e3013a3f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086783 Aug 08 17:19:08.861669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 751/1566] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:09.320614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:09.322833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:09.329171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:09.329657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:09.330129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:09.330821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:09.331307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:09.331735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:09.360879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-02d260ee-f2de-4896-ae32-c8e6c390984a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 08 17:19:09.361412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 816/1567] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:09.882840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:09.883399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:09.890256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:09.890737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:09.891416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:09.892106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:09.892557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:09.892980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:09.953086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:09.961929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d12704df-e6e6-4381-9332-a2ddaf2647d8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083412 Aug 08 17:19:09.962489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 752/1568] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:10.373273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:10.375529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:10.382536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:10.383017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:10.383461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:10.384145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:10.384650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:10.385069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:10.412952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8fd92788-0f20-4ffe-a7e1-c579b99634ea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 08 17:19:10.413492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 817/1569] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:10.982413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:10.983020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:10.990221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:10.990729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:10.991161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:10.991852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:10.992304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:10.992726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:11.052270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:11.059499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-510e2229-4bb5-431e-8459-f57c222701d4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080975 Aug 08 17:19:11.060053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 753/1570] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:11.424965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:11.427128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:11.433425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:11.433943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:11.434381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:11.435064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:11.435517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:11.435938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:11.464657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-489f78d7-de49-4bea-bb32-436a7cdc900e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Aug 08 17:19:11.465195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 818/1571] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:12.080063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:12.080777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:12.087181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:12.087658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:12.088092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:12.088778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:12.089231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:12.089653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:12.150114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:12.157683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-be6e8bb0-41ec-498d-8490-ff718a559180 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081468 Aug 08 17:19:12.159705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 754/1572] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:12.477450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:12.479622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:12.485974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:12.486456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:12.487507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:12.488186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:12.488659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:12.489065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:12.516937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8727542e-69b5-4afa-811b-4b1254156652 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 08 17:19:12.517472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 819/1573] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:13.177723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:13.178395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:13.184722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:13.185199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:13.185632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:13.186346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:13.186795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:13.187218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:13.250250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:13.258188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-909a3f65-de9c-4717-97a3-be1b4ad11d83 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084294 Aug 08 17:19:13.258752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 755/1574] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:13.528728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:13.530915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:13.537273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:13.537753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:13.538214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:13.538895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:13.539345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:13.539764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:13.556225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:13.568831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9ea1ed7-8ef8-440c-9ef9-085357ce4808 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 08 17:19:13.569366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 820/1575] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:14.280000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:14.280638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:14.287625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:14.288099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:14.288527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:14.289206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:14.289655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:14.290099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:14.351271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:14.358585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a441277e-7b70-4b79-8e92-308fb6678586 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082410 Aug 08 17:19:14.359146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 756/1576] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:14.580334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:14.583110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:14.589546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:14.590057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:14.590497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:14.591192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:14.591641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:14.592065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:14.620835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3d82e11a-2ed8-46a5-8aff-e2e39ac27082 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Aug 08 17:19:14.621415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 821/1577] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:15.378236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:15.378832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:15.385130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:15.385602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:15.386064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:15.386745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:15.387190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:15.387608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:15.447605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:15.455046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f6150f7-d183-4b7c-9b25-7dbb31eb2f8a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080686 Aug 08 17:19:15.455603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 757/1578] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:15.632927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:15.635083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:15.641373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:15.641883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:15.642320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:15.643760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:15.644233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:15.644652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:15.672636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e84132cc-5d69-4ef3-92ed-ed43ca5bb3ae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Aug 08 17:19:15.673173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 822/1579] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:16.475501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:16.476115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:16.482406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:16.482884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:16.483344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:16.484026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:16.484475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:16.484892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:16.544462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:16.552320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-255ebf61-aba7-444e-88c9-e96cbee32a65 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080745 Aug 08 17:19:16.552872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 758/1580] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:16.684502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:16.686710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:16.693919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:16.694400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:16.694836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:16.695514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:16.695961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:16.696436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:16.724714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0e27e383-bdcb-4484-bf41-4bdc12540502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 08 17:19:16.725245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 823/1581] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:17.572828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:17.573435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:17.579894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:17.581058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:17.581495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:17.582212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:17.582673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:17.583096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:17.647607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:17.654922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ef6322f-477a-4e5e-9f50-2165adaef76c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086022 Aug 08 17:19:17.655476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 759/1582] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:17.737134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:17.739298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:17.745632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:17.746146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:17.746586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:17.747267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:17.747716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:17.748141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:17.777350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-885eab14-4bfb-4862-8345-fad2ef1fae13 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Aug 08 17:19:17.777942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 824/1583] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:18.675272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:18.676209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:18.682579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:18.683055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:18.683487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:18.684160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:18.684604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:18.685018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:18.744775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:18.752041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-66c31897-9010-49ba-9f60-18c86f139f02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080574 Aug 08 17:19:18.752595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 760/1584] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:18.790350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:18.792525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:18.798945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:18.799430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:18.799871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:18.800562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:18.801016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:18.801440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:18.831847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cd33ed00-2da5-453d-b49c-9e3214b73724 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Aug 08 17:19:18.832594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 825/1585] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:19.772586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:19.773201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:19.779508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:19.779989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:19.780453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:19.781141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:19.781593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:19.782042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:19.841210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:19.843877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:19.846518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:19.849185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1848867-60c7-4103-af71-5e06d0b20563 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080453 Aug 08 17:19:19.849747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 761/1586] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:19.852848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:19.853334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:19.853819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:19.854549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:19.855005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:19.855430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:19.883839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3f26352c-f5ff-4cb1-a970-d4e87223b89d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Aug 08 17:19:19.884385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 826/1587] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:20.869917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:20.870457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:20.877534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:20.878226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:20.879022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:20.880179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:20.880295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:20.880729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:20.896560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:20.898857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:20.905461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:20.906003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:20.906440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:20.907334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:20.907795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:20.908222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:20.941210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-498a5029-6a78-40ac-8729-4a5c6921090a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048788 Aug 08 17:19:20.944963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:20.945757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 827/1588] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:20.952446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51cd4f20-86dc-49f1-95a4-2711ec556555 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086639 Aug 08 17:19:20.953009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 762/1589] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:21.953266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:21.956022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:21.962351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:21.962829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:21.963260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:21.963944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:21.964395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:21.964812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:21.972617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:21.973226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:21.979527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:21.980010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:21.980443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:21.981124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:21.981572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:21.982023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:21.994516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-19277bdf-49fe-432a-9250-33127ffab910 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 08 17:19:21.995092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 828/1590] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:22.046664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:22.054015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c647f51-d64e-4b18-8853-fcfa92b6389b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085162 Aug 08 17:19:22.054595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 763/1591] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:19:23.007040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:23.009197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:23.015572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:23.016318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:23.016758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:23.017449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:23.017937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:23.018367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:23.046678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eda43e9a-a81f-46ab-96d9-ad3d40f2185b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 08 17:19:23.047218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 829/1592] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:23.074068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:23.074683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:23.081440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:23.081956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:23.082388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:23.083064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:23.083513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:23.083931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:23.143476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:23.150764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d96eaee7-c1c2-4f1a-bc2e-b54bf009b606 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080455 Aug 08 17:19:23.151319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 764/1593] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:24.059394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:24.061530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:24.068016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:24.068493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:24.068928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:24.069607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:24.070086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:24.070511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:24.099165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4d3ac0b9-2e76-465e-9678-c845b8b4223f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Aug 08 17:19:24.099701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 830/1594] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:24.171874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:24.172485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:24.178854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:24.179325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:24.179752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:24.180430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:24.180881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:24.181296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:24.240692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:24.247998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bfa7755a-df06-41a5-8d56-7edfe1ea5822 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079960 Aug 08 17:19:24.248549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 765/1595] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:25.112167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:25.114348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:25.120634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:25.121113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:25.121549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:25.122267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:25.122716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:25.123135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:25.151405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-826d01bc-4594-45ad-af71-0dc9292fdeed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Aug 08 17:19:25.151936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 831/1596] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:25.269453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:25.270277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:25.276907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:25.277397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:25.277859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:25.278567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:25.279038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:25.279448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:25.342178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:25.350121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fbf99874-fc53-4e39-aff4-af70f7327cb8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084956 Aug 08 17:19:25.350684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 766/1597] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:26.164339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:26.166531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:26.172898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:26.173389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:26.173861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:26.174556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:26.175342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:26.175774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:26.203520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8fe1d3ff-83a7-4b33-96f0-173e9d4e17fe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Aug 08 17:19:26.204046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 832/1598] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:26.370485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:26.371100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:26.377528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:26.378045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:26.378486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:26.379173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:26.379628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:26.380054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:26.443117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:26.446555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:26.451030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c3b86cb2-19f0-468b-896d-4867c943619c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084386 Aug 08 17:19:26.451586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 767/1599] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:27.215404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:27.217429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:27.223779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:27.224262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:27.224698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:27.225379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:27.225857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:27.226282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:27.254071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-23b56d54-648d-4139-8867-36386dd3da6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Aug 08 17:19:27.254605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 833/1600] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:27.472618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:27.473223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:27.479698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:27.480174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:27.480607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:27.481282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:27.481729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:27.482170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:27.541876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:27.549910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6c0d1559-b6af-41c0-8da9-8388ffe3d4a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081577 Aug 08 17:19:27.550470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 768/1601] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:28.265296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:28.267781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:28.274149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:28.274625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:28.275058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:28.275737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:28.276189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:28.276611 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:28.305198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-17136b87-cc23-4250-a050-0cf556e36b3b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Aug 08 17:19:28.305740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 834/1602] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:28.570292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:28.570907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:28.577320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:28.577810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:28.578259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:28.578948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:28.579407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:28.580307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:28.643131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:28.650509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2b1ce30d-1203-4322-ab50-7b531c2fc14c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084080 Aug 08 17:19:28.651063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 769/1603] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:29.317351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:29.319506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:29.321778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=60 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:29.326408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:29.326893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:29.327334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:29.328026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:29.328479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:29.328902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:29.358465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9219315b-163f-4b84-9a4e-50153477d5a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 08 17:19:29.359017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 835/1604] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:29.671390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:29.672023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:29.678478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:29.678959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:29.679396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:29.680087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:29.680543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:29.680970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:29.740058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:29.747410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a6b931bd-4e8a-4af6-ad86-0b4197c7d42f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079859 Aug 08 17:19:29.747969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 770/1605] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:30.370240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:30.372450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:30.378958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:30.379439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:30.379878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:30.380569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:30.381021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:30.381447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:30.409980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8c9e9902-e039-4de7-9a86-30e9af932e1d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Aug 08 17:19:30.410464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 836/1606] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:30.769150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:30.769805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:30.776192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:30.776679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:30.777113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:30.777832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:30.778273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:30.778697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:30.841534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:30.849871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-886787c2-fd24-469b-9f8b-7cc3c70f353f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085330 Aug 08 17:19:30.850446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 771/1607] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:31.422171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:31.424867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:31.431297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:31.431786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:31.432254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:31.432950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:31.433415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:31.433883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:31.437403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:31.463154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ef7a8ba1-2d0c-4317-8176-e4e26d545f21 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Aug 08 17:19:31.463633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 837/1608] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:31.870293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:31.870915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:31.877343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:31.877850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:31.878286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:31.878970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:31.879425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:31.879853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:31.940254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:31.947717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c89aa32-4c65-4b63-bcd5-2bbbd1607c23 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081327 Aug 08 17:19:31.948277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 772/1609] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:32.475793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:32.478014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:32.484477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:32.484964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:32.485403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:32.486145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:32.486649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:32.487089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:32.515912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-77889fd0-a3b5-4956-98fe-09d86887482c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Aug 08 17:19:32.516471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 838/1610] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:32.968188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:32.968803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:32.975697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:32.976178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:32.976609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:32.977289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:32.977740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:32.978180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:33.038145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:33.045346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ee52b2f-bba3-4d78-9254-9c67503c47a4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081217 Aug 08 17:19:33.045954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 773/1611] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:33.528598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:33.530775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:33.537744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:33.538256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:33.538700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:33.539394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:33.539853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:33.540279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:33.569839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-99c49362-fb34-4dba-886e-08716ecd6560 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Aug 08 17:19:33.570389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 839/1612] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:34.067026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:34.067634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:34.074057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:34.074530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:34.074956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:34.075636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:34.076081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:34.076498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:34.136547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:34.145010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa7fc58d-4a27-428c-8c13-f44ffa58f872 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082370 Aug 08 17:19:34.145564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 774/1613] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:34 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:34.582053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:34.584282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:34.597910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:34.597910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:34.597910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:34.597910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:34.598406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:34.598406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:34.622389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c5ae047b-ba45-4f73-9364-26c199fceb8e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 08 17:19:34.622939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 840/1614] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:35.165281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:35.165919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:35.172366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:35.172842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:35.173341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:35.174101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:35.174550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:35.174969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:35.239004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:35.246477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ddc59c5a-f176-4373-86e0-9903bcec2675 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085252 Aug 08 17:19:35.247040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 775/1615] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:35.635270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:35.637417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:35.644796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:35.645281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:35.645722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:35.646444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:35.646898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:35.647324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:35.675177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-437c63e7-1997-4a1c-9101-7964d0da77a7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Aug 08 17:19:35.675716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 841/1616] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:36.267025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:36.267641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:36.274606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:36.275091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:36.275525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:36.276217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:36.276669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:36.277091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:36.338685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:36.346555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2dbed7a1-7365-4800-b1ab-27cdb124b55a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083606 Aug 08 17:19:36.347124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 776/1617] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:19:36.686862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:36.688986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:36.695308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:36.695786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:36.696218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:36.696899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:36.697345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:36.697762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:36.726634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f2d4aef-b26d-4c72-89dd-e66880129aa4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Aug 08 17:19:36.727168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 842/1618] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:37.367472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:37.368090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:37.370415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:37.375099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:37.375624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:37.376066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:37.377363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:37.377823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:37.378256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:37.438481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:37.446599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a77c38f-771e-48d1-8afd-d1b9b3d398b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083070 Aug 08 17:19:37.447166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 777/1619] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:37.739821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:37.742060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:37.748396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:37.748872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:37.749305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:37.750012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:37.750464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:37.750885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:37.778835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-468c04ce-f41e-471d-9eac-bf9e0c05bd6e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Aug 08 17:19:37.779372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 843/1620] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:38.466837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:38.467453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:38.473953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:38.474438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:38.474873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:38.475562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:38.476016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:38.476444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:38.537231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:38.544648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1cf7cda6-c9cf-4add-9af5-dad3347bc9a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081684 Aug 08 17:19:38.545212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 778/1621] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:38.791884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:38.794031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:38.800923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:38.801399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:38.801853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:38.802602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:38.803049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:38.803472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:38.833435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a0d5d35b-0455-4795-81b0-798511e7254c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 Aug 08 17:19:38.834024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 844/1622] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:39.564350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:39.564984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:39.571332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.571809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.572241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.572925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.573373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.573844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.603334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:39.603846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:39.609690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.610227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.610699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.611403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.611860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.612423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.637558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Going to try to terminate instance {{(pid=130500) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:19:39.642935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:39.660040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2fada83a-22d2-4daf-8981-f622d14f23b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.099448 Aug 08 17:19:39.660801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 779/1623] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:39.844844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:39.847109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:39.853228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.853723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.854197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.854914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.855371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.855795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.885680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7e59d14-9e51-45a1-9c8d-33c2e8371a0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Aug 08 17:19:39.889677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 780/1624] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:39.937659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c6f4153e-9de0-4a3d-9b6c-209db2b0157d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 204 len: 0 microversion: 2.20 time: 0.338320 Aug 08 17:19:39.938317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 845/1625] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Aug 8 17:19:39 2022] DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 17:19:39.946692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:39.947298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:39.953524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.954037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.954555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:39.955245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:39.955697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:39.956122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:40.081111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:40.089385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:40.090914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:40.092065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-500fe817-5022-41dc-bcb0-c351340ff133 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1800 microversion: 2.20 time: 0.149121 Aug 08 17:19:40.092620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 781/1626] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:40.681066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:40.681887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:40.687715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:40.688193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:40.689118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:40.689818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:40.690270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:40.690691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:40.752878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:40.760343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-926aa3e3-799e-4c2c-a54c-d3c05f4c4264 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083498 Aug 08 17:19:40.761053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 846/1627] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:40.898872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:40.901195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:40.907656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:40.908139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:40.908576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:40.909270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:40.909720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:40.910165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:40.938345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f1e1a8de-96af-4354-9f21-2f941338b502 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Aug 08 17:19:40.939379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 782/1628] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:41.115445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:41.116055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:41.122713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.123196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.123628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.124319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.124768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.125189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.353837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:41.362940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:41.364425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:41.365618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b003ea99-7cdd-4fbd-badc-c1d59b6d0ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1800 microversion: 2.20 time: 0.254015 Aug 08 17:19:41.366192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 847/1629] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1800 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:41.781806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:41.783027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:41.789168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.789761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.790237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.791048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.791505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.791936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.853420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:41.860985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc611bb3-070d-4a44-b9e0-0011dcf2861a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083066 Aug 08 17:19:41.861549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 783/1630] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:41.952207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:41.955136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:41.961205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.961755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.962176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.963232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.963694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.964312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:41.980781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea", "name": "network-vif-deleted", "tag": "6bd772fe-43b4-474f-a189-1a72dff7f63d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:19:41.991597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:41.992164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:41.992824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:42.006193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] Creating event network-vif-deleted:6bd772fe-43b4-474f-a189-1a72dff7f63d for instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea on hv-cinder-85221 Aug 08 17:19:42.011889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2fe1afff-1890-49a9-8809-490240869685 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064317 Aug 08 17:19:42.013936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-6d0f7a88-b0bb-4f59-8b38-94f24949d225 req-cde7d4cd-0143-4796-b2a6-45a4cd88f3b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Aug 08 17:19:42.014060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 848/1631] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:42.014215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 784/1632] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:42.388646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:42.389336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:42.396497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:42.396972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:42.397404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:42.398127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:42.398590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:42.399008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:42.460779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:42.469252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:42.470819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:42.471980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc0f5cfb-2cee-426e-a482-fe1a0804501b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087321 Aug 08 17:19:42.472527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 849/1633] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:42.882797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:42.883497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:42.890165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:42.890653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:42.891084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:42.891856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:42.892305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:42.892726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:42.897309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:42.961381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:42.969468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40a69025-d029-4a75-93cf-ced9ec094a67 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.090867 Aug 08 17:19:42.970648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 785/1634] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:43.024505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:43.026697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:43.032709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.033195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.033637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:43.034368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.034827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.035253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:43.064546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fd495a95-962f-4f0f-9d75-5b3a9f88449d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 08 17:19:43.065088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 850/1635] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:43.494609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:43.495344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:43.502406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.502889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.503329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:43.504015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.504498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.504922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:43.565515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:43.573875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:43.575381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:43.576546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf36b5e6-7299-4f8a-9a94-797326aabdde tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085854 Aug 08 17:19:43.577098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 786/1636] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:43.990203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:43.990819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:43.997135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.997619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.998081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:43.998771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:43.999226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:43.999652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:44.062541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:44.069937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-69d5f6ce-e0ea-4a61-b60f-e6976efe86b4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083535 Aug 08 17:19:44.070497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 851/1637] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:44.076368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:44.078612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:44.084988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:44.085475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:44.085950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:44.086640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:44.087096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:44.087522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:44.116216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7d2f88f-27f1-428e-80cf-b86d62f68e76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Aug 08 17:19:44.116768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 787/1638] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:44.598028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:44.598669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:44.604734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:44.605215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:44.605652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:44.606372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:44.606830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:44.607252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:44.611307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:44.669117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:44.677939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:44.679457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:44.680641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2b0a5c14-d14d-4322-97b2-cd8d1e9f7d91 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086595 Aug 08 17:19:44.681203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 852/1639] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:45.090703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:45.091320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:45.097756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.098271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.098712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.099397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.099849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.100271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.128865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:45.131092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:45.138140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.138627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.139069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.139756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.140462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.140914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.161813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:45.169478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b442ef59-7c44-4e10-96fd-647886291a12 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082507 Aug 08 17:19:45.170047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 788/1640] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:45.170612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f37fbeb8-2c1c-40f7-b3a4-413d0d057687 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Aug 08 17:19:45.171168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 853/1641] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:45.703571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:45.704681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:45.711022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.711499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.711927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.712607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:45.713055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:45.713489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:45.773769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:45.782918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:45.784401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:45.785536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44513b0f-cc24-42ea-8076-3b745a6103c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085905 Aug 08 17:19:45.786124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 789/1642] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:46.183662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:46.185850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:46.190999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:46.191617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:46.192656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.193150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.193621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.194377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.194837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.195426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.198233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.198715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.199151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.199839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.200296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.200728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.224535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f7e9d578-413e-4a25-81ee-6d67414e3ec5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Aug 08 17:19:46.225106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 854/1643] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:46.260629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:46.268885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8dbcecda-36b6-4f47-b200-db0e6867831a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082154 Aug 08 17:19:46.269436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 790/1644] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:46.807598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:46.808209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:46.814189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.814674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.815109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.815799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:46.816252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:46.816677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:46.875711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:46.884043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:46.885545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:46.886715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-35495108-7b74-44cc-a187-95bc1b6afa55 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083059 Aug 08 17:19:46.887271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 855/1645] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:47.236531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:47.238729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:47.245085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.245561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.246034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.246716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.247164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.247582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.275791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8f825e8-0295-4853-b26c-49cdde5d8f74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Aug 08 17:19:47.276320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 791/1646] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:47.288934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:47.289555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:47.295907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.296387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.296833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.297522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.298013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.298440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.359350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:47.366798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-299c0bcf-1f12-452d-bb63-d9e445a96b2f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081713 Aug 08 17:19:47.367359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 856/1647] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:47.909842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:47.910396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:47.916285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.916759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.917187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.917895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:47.918364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:47.918766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:47.982002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:47.990350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:47.991856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:47.992987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9b16170-76a5-4ec4-bd44-25fccdad3a79 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087783 Aug 08 17:19:47.993733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 792/1648] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:48.287981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:48.290175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:48.296535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:48.297023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:48.297470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:48.298206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:48.298669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:48.299100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:48.327271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-22a55a8d-8bb3-4b06-b87d-eb29973c06da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Aug 08 17:19:48.327820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 857/1649] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:48.387115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:48.387733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:48.395020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:48.395501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:48.395936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:48.396647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:48.397099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:48.397531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:48.461179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:48.468667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-539db853-f39d-4ac3-977c-1617e59e2a48 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085398 Aug 08 17:19:48.469231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 793/1650] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:49.016099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:49.016740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:49.023306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.024165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.024597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.025287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.025740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.026189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.088700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:49.097776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:49.099292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:49.100421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9dc6e10f-ce8a-4807-8050-64262fad9919 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089007 Aug 08 17:19:49.101032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 858/1651] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:19:49.340241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:49.342367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:49.348920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.349406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.349865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.350554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.351009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.351467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.380182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc84ddaf-a75e-4e5b-ae8b-0ee74333c99d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Aug 08 17:19:49.380723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 794/1652] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:49.490166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:49.490784 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:49.497093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.497574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.498050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.498738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:49.499194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:49.499617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:49.559170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:49.566509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4002f1ef-d02d-49ca-b986-4c4098e354fb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080529 Aug 08 17:19:49.567064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 859/1653] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:50.124439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:50.125050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:50.132094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.132574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.133008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.133693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.134177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.134609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.194615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:50.202905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:50.204465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:50.205602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ff642ed0-4ee1-4958-b21d-bafd05923dee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085094 Aug 08 17:19:50.206190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 795/1654] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:50.392527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:50.394672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:50.400614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.401100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.401541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.402259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.402717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.403146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.431143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-57181408-17df-4e74-bafd-57bd5acb87d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Aug 08 17:19:50.431686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 860/1655] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:50.587542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:50.588149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:50.594212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.595188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.595803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.596426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:50.596876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:50.597309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:50.659314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:50.666769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d4776f0-06da-403b-a57c-5b18b6cd93bd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083051 Aug 08 17:19:50.667326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 796/1656] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:51.228206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:51.228814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:51.235279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.235769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.236185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.236868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.237319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.237738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.297474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:51.305608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:51.307130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:51.308268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c79b1564-e46f-455f-aacb-8fb6a729acf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083960 Aug 08 17:19:51.308821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 861/1657] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:51.443868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:51.446073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:51.452359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.452849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.453280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.454037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.455026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.455448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.483577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3a206b72-57dc-4611-a2f2-f983b2488cde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Aug 08 17:19:51.484060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 797/1658] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:51.688756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:51.689366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:51.695229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.695706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.696134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.696821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:51.697275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:51.697694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:51.757317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:51.765471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-189e0038-4f8a-498b-a35b-759f38b4b1c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081177 Aug 08 17:19:51.766140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 862/1659] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:52.331629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:52.332243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:52.338336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.338818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.339256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.339940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.340390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.340812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.403403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:52.412621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:52.414114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:52.415277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ee91db3e-d344-4e1a-b7ec-1daa617b344c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088093 Aug 08 17:19:52.415824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 798/1660] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:52.495477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:52.497686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:52.504040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.504519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.504952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.505636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.506118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.506541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.535864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-91350287-6d56-48b3-b30e-1f7536f9e5c1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 08 17:19:52.536408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 863/1661] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:52.786017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:52.786669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:52.792983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.793468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.793941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.794634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:52.795087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:52.795509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:52.856495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:52.863904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-62591b97-62b6-4fc8-a9bb-7cb36cf0d221 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081738 Aug 08 17:19:52.864464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 799/1662] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:53.436970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:53.437580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:53.444323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.444801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.445231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.445942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.446390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.446812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.508778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:53.517262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:53.518776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:53.519906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-48850ed7-6787-480e-aba4-3ba6c5196629 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086951 Aug 08 17:19:53.520451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 864/1663] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:53.548630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:53.550876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:53.556796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.557288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.557835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.558889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.559356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.559794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.587879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-821bb505-8e7b-4530-9448-7cd142230dfd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Aug 08 17:19:53.588438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 800/1664] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:53.884454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:53.885072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:53.893140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.894610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.894610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.894817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:53.895262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:53.895689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:53.955782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:53.963088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b98b873e-c5a2-44ed-8cd1-f32ba3ab0860 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082461 Aug 08 17:19:53.963649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 865/1665] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:54.542187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:54.542827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:54.549656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.550164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.550595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:54.551273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.551722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.552141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:54.600130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:54.602326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:54.608800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.609283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.610231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:54.610932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.611485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.611786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:54.613603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:54.617256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:54.622687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:54.626374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:54.626374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-069e88a1-b1e6-460e-b9f2-cc0595c91a82 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087138 Aug 08 17:19:54.627351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 801/1666] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:54.642853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e1dfd46d-a177-464b-8853-32f507da9daf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Aug 08 17:19:54.643396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 866/1667] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:19:54.984107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:54.985332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:54.991854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.992344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.992783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:54.993476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:54.993968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:54.994396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:55.054093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:55.061514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-427234cd-9a64-4f96-bcd5-1b67f94e2db7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081282 Aug 08 17:19:55.062115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 802/1668] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:55.649008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:55.649619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:55.654836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:55.656162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:55.657292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:55.657731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:55.657914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:55.658443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:55.658893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:55.659313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:55.663886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:55.664364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:55.664799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:55.665867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:55.666343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:55.666765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:55.697247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2afc3136-2e10-4be7-a26a-3df6baa87beb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Aug 08 17:19:55.697851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 803/1669] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:55.721919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:55.730278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:55.731764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:55.732893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4447a159-6dcc-4d45-9cf3-42358131185c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087816 Aug 08 17:19:55.733445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 867/1670] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:56.082361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:56.082975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:56.088920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.089430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.089893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.090587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.091041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.091468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.154456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:56.162013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-124e4aa5-523b-46bf-beaf-5ed2b7f21273 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083607 Aug 08 17:19:56.162575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 804/1671] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:56.709503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:56.711610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:56.718073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.718553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.719544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.720256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.720706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.721128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.745098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:56.749421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f430dcf9-f431-47bc-8e63-29eefa2dfc16 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Aug 08 17:19:56.749990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 868/1672] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:56.754950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:56.757949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:56.762028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.762510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.763011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.763685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:56.764139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:56.764819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:56.825838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:56.834781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:56.836286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:56.837485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e452c953-53e4-4044-9806-8c9880453489 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086444 Aug 08 17:19:56.838081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 805/1673] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:19:57.184256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:57.184872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:57.191494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.191983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.192423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.193115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.193575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.194030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.253064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:57.260467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6396ee99-f826-4048-b573-0d49856ef7e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080382 Aug 08 17:19:57.261027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 869/1674] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:57.760589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:57.762753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:57.769517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.770033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.770471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.771150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.771605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.772027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.800712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c68d2f68-c3f5-4739-9862-73ac4c64a998 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Aug 08 17:19:57.801258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 806/1675] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:57.860910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:57.861444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:57.867868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.868349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.868779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.869462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:57.869952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:57.870380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:57.933226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:57.942270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:57.943754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:57.944884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a0c1383c-de69-45b1-bc31-40be789046eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088392 Aug 08 17:19:57.945438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 870/1676] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:58.281199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:58.282328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:58.288218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.288694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.289126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:58.289824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.290278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.290694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:58.351199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:58.358679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28a6970e-8113-45d0-82c5-e8a44c76c83e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081603 Aug 08 17:19:58.359228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 807/1677] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:58.813106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:58.815326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:58.821253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.821743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.822218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:58.822911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.823372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.823802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:58.852325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d1eceba8-2493-47bf-a250-d11e439e2ebb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Aug 08 17:19:58.852801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 871/1678] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:19:58.967414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:58.968002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:58.974691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.975166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.975595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:58.976279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:58.976728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:58.977142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:59.039209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:59.048072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:59.049610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:59.050771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f84e978d-5e0a-4bd9-a7cf-e7620efff8c2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087726 Aug 08 17:19:59.051323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 808/1679] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:19:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:19:59.379762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:59.380378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:59.382680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:19:59.387303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:59.392301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:59.392301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:59.392301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:59.392301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:59.392687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:59.450090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:19:59.457841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0aff4e02-6276-4f67-a45b-380f90858d5d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082551 Aug 08 17:19:59.458399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 872/1680] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:19:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:19:59.864739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:19:59.866989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:19:59.872949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:59.873553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:59.874699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:59.875767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:19:59.876232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:19:59.876661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:19:59.905864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41fe78c1-1ce9-4cd0-bbfd-07ac0a242a92 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Aug 08 17:19:59.907090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 809/1681] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:19:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:00.079732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:00.080341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:00.086314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.086791 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.087224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.087909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.088358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.088786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.149111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:00.157974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:00.159476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:00.160647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-40a6ffd4-dfa4-45cc-9d19-db2f898a1191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085413 Aug 08 17:20:00.161203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 873/1682] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:00.478704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:00.479309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:00.485583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.486093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.486526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.487206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.487654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.488073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.552013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:00.559611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0c10c3ed-a7b9-4c39-a21a-55485372f581 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084723 Aug 08 17:20:00.560168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 810/1683] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:00.918794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:00.920975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:00.929757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.930270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.930705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.931399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:00.931850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:00.932272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:00.960560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f7e47aba-59eb-47d2-b85d-8dcbdd4b1f76 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Aug 08 17:20:00.961103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 874/1684] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:01.182912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:01.183438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:01.189310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.189807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.190250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:01.190936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.191433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.191850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:01.257542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:01.266574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:01.268094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:01.269236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4a1a40cd-8f9b-48ba-8408-65969fdf57e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090419 Aug 08 17:20:01.269806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 811/1685] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:01.580296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:01.580934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:01.587044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.587531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.587984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:01.588660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.589116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.589548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:01.651666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:01.659128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-277d18fc-f99d-4e6e-9450-2f3363ffd621 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082747 Aug 08 17:20:01.659682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 875/1686] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:01.973057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:01.975251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:01.981616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.982128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.982561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:01.983242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:01.983688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:01.984105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:02.013973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2acefc9-ff0d-415a-be46-0680ff9be9b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Aug 08 17:20:02.014789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 812/1687] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:02.292381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:02.292922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:02.299278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:02.299755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:02.300189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:02.300869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:02.301316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:02.301737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:02.363690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:02.371872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:02.373366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:02.374525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-60d670d6-abf2-48ec-a6e7-26a942dc89ab tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086159 Aug 08 17:20:02.375102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 876/1688] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:02.680251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:02.680864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:02.686926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:02.687411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:02.688342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:02.689025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:02.689477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:02.689925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:02.748992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:02.756900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c238584c-00f7-43a0-93f9-371c35828188 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080597 Aug 08 17:20:02.757460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 813/1689] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:03.026364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:03.028519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:03.035078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.035569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.036023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.036716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.037177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.037606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.065209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1488352f-8282-4479-aad1-aeafc210947a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 Aug 08 17:20:03.065762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 877/1690] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:03.397133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:03.397672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:03.404157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.407156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.407156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.407156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.407156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.407654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.467612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:03.475858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:03.477348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:03.478496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dde64e37-7333-406b-9cb8-308a4058ca17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085390 Aug 08 17:20:03.479041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 814/1691] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:03.778136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:03.778745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:03.785050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.785529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.786686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:03.787137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:03.787558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:03.846920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:03.854254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c317836a-2060-416c-a429-f79fac4637eb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079854 Aug 08 17:20:03.854813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 878/1692] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:04.077605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:04.212622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:04.212622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.212622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.212622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.213931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.213931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.213931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.213931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ab3575f8-b5eb-4dd1-b651-97621e8ba5b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050591 Aug 08 17:20:04.214290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 815/1693] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:04.500510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:04.501133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:04.507189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.507675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.508115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.508809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.509265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.509692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.570685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:04.579426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:04.580925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:04.582094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-10b429f0-9e59-4ce9-b343-83b738d3dfb3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085495 Aug 08 17:20:04.582645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 879/1694] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:04.875605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:04.876146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:04.882686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.883173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.883614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.884309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:04.884767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:04.885195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:04.948390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:04.956472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0cc332a8-309f-4457-b875-75ebd82c0e0a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085363 Aug 08 17:20:04.957071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 816/1695] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:05.136547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:05.138658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:05.145390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.145902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.146340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:05.147024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.147476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.147893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:05.176005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-541588d9-7810-4e11-82fe-43576569d54f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Aug 08 17:20:05.176539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 880/1696] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:05.604538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:05.605170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:05.611669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.612145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.612573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:05.613249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.613725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.614206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:05.673624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:05.681932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:05.683423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:05.684544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccab6bd5-abb8-4731-a215-ee12757bab83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083963 Aug 08 17:20:05.685097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 817/1697] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:05.976874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:05.977493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:05.983595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.984075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.984514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:05.985199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:05.985656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:05.986119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:06.046256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:06.053616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-059601e6-8b1d-4491-9b55-0c8a738003a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080589 Aug 08 17:20:06.054212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 881/1698] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:06.188529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:06.190735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:06.197073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:06.197557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:06.198037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:06.198727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:06.199183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:06.199609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:06.216405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:06.230629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e77af897-4161-4748-8da9-1cc0e6aba5b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 08 17:20:06.230629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 818/1699] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:06.706587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:06.707207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:06.713613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:06.714134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:06.714577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:06.715299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:06.715759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:06.716189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:06.778741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:06.787124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:06.788640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:06.789780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4077929e-9164-4a7d-8dfa-2234284f6959 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087150 Aug 08 17:20:06.790366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 882/1700] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:07.074440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:07.075045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:07.081114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.081596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.082299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.082983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.083431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.083850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.143237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:07.150570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12bb74cb-bded-47cb-9792-bd7c6216ea13 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080371 Aug 08 17:20:07.151123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 819/1701] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:07.241401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:07.243635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:07.249530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.250047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.250493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.252235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.252693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.253127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.281520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d208ad71-be0d-435f-a55d-798f0936a7b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Aug 08 17:20:07.282049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 883/1702] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:07.812903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:07.813515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:07.815827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:07.820493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.820974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.821420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.822137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:07.822616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:07.825718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:07.884424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:07.893574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:07.895114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:07.896254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9a33c9ae-bc3c-4e28-8ca2-5c52cf3ce70a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087792 Aug 08 17:20:07.896812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 820/1703] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:08.172175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:08.172827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:08.179370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.179857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.180298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.181009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.181457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.181921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.243214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:08.251290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-82dc0a0b-2507-4d29-b116-50ef7a61a436 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083502 Aug 08 17:20:08.251858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 884/1704] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:08.293447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:08.295657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:08.302023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.302506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.302942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.303659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.304113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.304537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.334117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ecd35cfe-e41f-4473-b328-cb9b037db16a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 08 17:20:08.334655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 821/1705] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:08.918363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:08.918897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:08.924911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.925397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.925863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.926556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:08.927014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:08.927442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:08.944926 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:08.989869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:08.998272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:08.999756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:09.000932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-013f773b-9977-43a8-99ad-d91c7f990279 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086547 Aug 08 17:20:09.001481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 885/1706] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:09.272399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:09.273043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:09.279452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:09.279922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:09.280350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:09.281024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:09.281471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:09.281919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:09.345531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:09.345689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:09.347751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:09.353105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7aac730e-f3e2-46ec-a561-b606c6722580 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084532 Aug 08 17:20:09.356944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 822/1707] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:09.357103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:09.357103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:09.357103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:09.357103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:09.357454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:09.357454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:09.385445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e69837b8-5d1d-4b7c-8c40-9c97e221f86f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Aug 08 17:20:09.386023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 886/1708] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:10.023773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:10.024392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:10.030330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.030811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.031748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.032432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.032886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.033312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.092497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:10.101219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:10.102748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:10.103918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f290854c-f855-4097-95e7-227802b75b19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084121 Aug 08 17:20:10.104471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 823/1709] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:10.373947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:10.374480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:10.380888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.381362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.381810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.382573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.383025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.383446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.397319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:10.399634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:10.405994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.407013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.407451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.408167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:10.408622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:10.409042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:10.437932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c28424fa-1115-4ac1-83b1-15248d5da334 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Aug 08 17:20:10.438489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 824/1710] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:10.444690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:10.452133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb6b8a6a-16e5-49b6-a59c-1763d443985e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082145 Aug 08 17:20:10.452676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 887/1711] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:11.127417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:11.128029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:11.133971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.134454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.134889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.135575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.136027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.136451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.195806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:11.203987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:11.205485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:11.206655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1b39046-fd9c-4dd5-9ef9-1531ebc043ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083748 Aug 08 17:20:11.207205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 825/1712] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:11.449551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:11.451647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:11.457998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.458481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.458915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.459598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.460078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.460500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.473299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:11.473936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:11.480274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.480764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.481198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.481923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:11.482380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:11.482804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:11.491452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-954f1964-8bb9-48bd-86b5-9c33b3e93477 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Aug 08 17:20:11.505272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 888/1713] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:11.543951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:11.551958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-498c7995-ee73-4a4b-96d4-5c5687886cdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082547 Aug 08 17:20:11.552517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 826/1714] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:12.228565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:12.229231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:12.235207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.235690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.236128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.236841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.237283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.237708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.300542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:12.308986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:12.310536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:12.311694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7b0b35f1-7772-414a-8123-226aee445640 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087086 Aug 08 17:20:12.312784 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 889/1715] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:12.516338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:12.518513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:12.524796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.525268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.525697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.526477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.526928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.527348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.555716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de403554-aa85-415a-913a-52a9988432de tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 08 17:20:12.556251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 827/1716] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:12.571843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:12.572465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:12.578804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.579318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.579761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.580458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:12.580920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:12.581356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:12.642077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:12.649413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cfb1975e-786c-4bd1-8257-d14bf7530ef0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081334 Aug 08 17:20:12.650006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 890/1717] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:13.334927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:13.335557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:13.341903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.342397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.342838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.344193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.344651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.345080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.407978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:13.416305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:13.417850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:13.419029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d81267c5-c80c-4d25-9023-239ebdbf0659 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088079 Aug 08 17:20:13.419582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 828/1718] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:13.567560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:13.569706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:13.576047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.576618 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.576946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.577631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.578122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.579031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.609007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-af652171-8519-4c14-9e87-2e96dbf52313 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 08 17:20:13.609587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 891/1719] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:13.669373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:13.670034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:13.676441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.676924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.677359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.678070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:13.678526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:13.678947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:13.738509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:13.745749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e847bbae-d7b4-42b5-be22-08c7dc79cbae tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080167 Aug 08 17:20:13.746338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 829/1720] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:14.441762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:14.442529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:14.448619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.449169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.449719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.450498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.450945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.451368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.515358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:14.524301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:14.525880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:14.527019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-43900ec6-b9a8-483f-99b1-365a9d9e5f28 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089697 Aug 08 17:20:14.527598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 892/1721] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:14.620637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:14.622888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:14.629294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.630328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.630328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.630909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.631367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.631787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.663055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-771ac29b-8fc7-4446-8f43-f58894ba20f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046368 Aug 08 17:20:14.663607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 830/1722] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:14.769910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:14.770533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:14.776902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.777397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.777873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.778577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:14.779041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:14.779477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:14.841170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:14.848733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dc8bd2f3-5534-49ef-aa7e-ab360e859a37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083256 Aug 08 17:20:14.849295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 893/1723] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:15.549031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:15.549639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:15.556034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.556516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.556952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.557635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.558117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.558546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.619141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:15.627563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:15.629057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:15.630345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9902cdf9-f2a1-4f1d-92f1-de64f9fa911b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085087 Aug 08 17:20:15.630894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 831/1724] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:15.675451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:15.677617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:15.683709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.684189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.684623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.685307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.685755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.686199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.713734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1fabd33c-d4fe-4cae-ac99-80a688bb2643 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Aug 08 17:20:15.714293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 894/1725] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:15.869694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:15.870257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:15.876697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.877174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.877608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.878319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:15.878772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:15.879201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:15.937898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:15.945710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-831c9bbe-1c23-4cab-9f56-1a1c069c0b7c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080216 Aug 08 17:20:15.946297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 832/1726] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:16.653841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:16.654468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:16.660867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.661346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.661779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:16.662494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.662947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.663372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:16.725867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:16.726594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:16.729001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:16.734276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:16.734831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.735312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.736398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:16.736536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:16.737087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.737536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.737656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9c92169a-0e40-4ea9-922d-5eea64bc2cd2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087636 Aug 08 17:20:16.737990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:16.738410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 895/1727] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:16.766121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70284e09-8b81-4ffa-a535-bfb3225570c4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Aug 08 17:20:16.766657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 833/1728] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:16.966686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:16.967339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:16.973844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.974332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.974772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:16.975460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:16.975914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:16.976339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:17.035906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:17.043257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-81da97e8-d3f2-41a0-ac15-6754f97b41da tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080371 Aug 08 17:20:17.043934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 896/1729] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:17.760042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:17.760646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:17.767771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:17.768248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:17.768705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:17.769383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:17.769851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:17.770269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:17.778229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:17.780412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:17.787498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:17.788267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:17.788722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:17.789417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:17.789907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:17.790346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:17.819285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bf9f7dba-918a-4fef-bf80-8f6067376dfe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Aug 08 17:20:17.820052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 897/1730] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:17.835464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:17.843860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:17.845888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:17.847008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f9ccdae1-60d3-4cb4-ba77-e28919484a2b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090919 Aug 08 17:20:17.847559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 834/1731] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:18.063322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:18.063947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:18.069841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.070337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.070778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.071473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.071964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.072395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.132292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:18.139938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c0e60782-d946-4b9e-a4d6-94d8fd6ffec3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080469 Aug 08 17:20:18.140499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 898/1732] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:18.831872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:18.834034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:18.840414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.840836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.841268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.841981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.842430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.842849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.847104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:18.868575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:18.869294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:18.871259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-edc93567-89b1-4dd2-8743-a4c4986721db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Aug 08 17:20:18.871815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 835/1733] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:18.876284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.876780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.877222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.877960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:18.878420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:18.878845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:18.939429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:18.947739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:18.949237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:18.950400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-641ad178-64fc-4ea1-922f-d31999c07f37 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085749 Aug 08 17:20:18.950955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 899/1734] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:19.160655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:19.161168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:19.167547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.168024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.168452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:19.169130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.169578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.170024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:19.231830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:19.239601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a8effd7-7783-4661-a54d-d6c938c14b14 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082889 Aug 08 17:20:19.240165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 836/1735] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:19.884408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:19.886535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:19.893157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.893637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.894105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:19.894789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.895241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.895662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:19.929180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6fb01969-6538-4ff3-8a08-9ba0096f4165 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Aug 08 17:20:19.930133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 900/1736] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:19.974407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:19.975014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:19.982075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.982554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.982982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:19.983661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:19.984106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:19.984523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:20.048061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:20.056379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:20.057896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:20.059052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e46223d8-d660-4810-80ca-0f669aa07c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088542 Aug 08 17:20:20.059602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 837/1737] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:20.260513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:20.261124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:20.267802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:20.268280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:20.268713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:20.269395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:20.269983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:20.270332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:20.332269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:20.339686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-24244147-dc73-4407-887d-bb8d7ad708a6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083045 Aug 08 17:20:20.340239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 901/1738] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:20.941351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:20.943523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:20.949445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:20.949972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:20.950409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:20.951089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:20.951534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:20.951951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:20.981951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f9bfdb33-33bb-40f1-9f17-6a5fd95dcfec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Aug 08 17:20:20.982614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 838/1739] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:21.081645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:21.082307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:21.088701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:21.089187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:21.089629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:21.090371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:21.090824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:21.091249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:21.095958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:21.153563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:21.161845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:21.163358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:21.164499 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7e045fcd-3567-4012-ae96-a9460772f34d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087227 Aug 08 17:20:21.165074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 902/1740] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:21.360710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:21.361360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:21.367341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:21.367825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:21.368267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:21.368954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:21.369411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:21.369862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:21.431134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:21.439002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-be231c5c-2444-4dc4-92c4-88acf10dd509 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081640 Aug 08 17:20:21.439558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 839/1741] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:21.569443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:20:21.569682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:20:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:20:21.993671 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:21.995885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:22.001915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.002411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.002851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.003545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.004000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.004426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.032932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b825162-638b-49c5-b516-f07c07daf7ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Aug 08 17:20:22.033475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 903/1742] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:22.186732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:22.187348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:22.193734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.194276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.194717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.195408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.195892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.196325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.260383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:22.269658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:22.271191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:22.272368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f1a94c11-2b28-4976-bc4b-a7a7413bdc04 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089630 Aug 08 17:20:22.272920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 840/1743] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:22.459565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:22.460181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:22.466506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.466978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.467406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.468087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:22.468538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:22.468957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:22.529099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:22.538239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb8c0c52-1065-4965-8238-8efbe905ab20 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082452 Aug 08 17:20:22.538800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 904/1744] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:23.045062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:23.047288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:23.053916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.054410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.054860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.055556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.056022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.056447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.085398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b046547-3253-45c2-b563-a40ed619d0ab tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Aug 08 17:20:23.086027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 841/1745] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:23.295477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:23.296130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:23.304831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.305279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.305710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.306504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.306961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.307382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.385717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:23.394388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:23.395877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:23.397011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c9f967d6-249b-4947-8c28-204a8588cf86 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.105549 Aug 08 17:20:23.397556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 905/1746] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:23.559300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:23.559850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:23.566395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.566877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.567318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.568010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:23.568466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:23.568893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:23.629317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:23.636741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2e0ff1d-bbd4-48e8-b8c7-cad6fc4a5f60 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081454 Aug 08 17:20:23.637332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 842/1747] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:24.097220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:24.099472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:24.105808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.106286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.106724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.107414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.107866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.108289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.136441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5ee7b5a1-6ebd-4f32-87be-fc43711b9206 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 08 17:20:24.136975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 906/1748] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:24.392002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:20:24.392193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:20:24.419581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:24.420190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:24.426160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.426643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.427112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.427793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.428242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.428664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.488809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:24.497172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:24.498710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:24.499853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1b89893-2846-4c89-a42d-ab82527a10c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083977 Aug 08 17:20:24.500402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 843/1749] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:24.660698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:24.661251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:24.667390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.667877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.668354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.669050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:24.669509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:24.669990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:24.729467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:24.737558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2471369a-be66-4f0e-8d55-a62836eb30ab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080920 Aug 08 17:20:24.738152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 907/1750] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:25.148247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:25.150415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:25.156714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.157688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.158152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.158862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.159308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.159723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.187876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9da84960-2740-4b1b-9b66-30818a848ad1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Aug 08 17:20:25.188410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 844/1751] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:25.429320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:20:25.429772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:20:25.523061 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:25.523712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:25.530171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.530655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.531092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.531786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.532870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.533297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.592881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:25.601947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:25.603439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:25.604571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-054be04b-5bd8-4667-a495-8e2a3e1bac01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085376 Aug 08 17:20:25.605112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 908/1752] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:25.757779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:25.758452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:25.764611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.765085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.765512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.766779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:25.767231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:25.767650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:25.826535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:25.834408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0134b0cc-c7d4-4334-bad2-0d133485406c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080392 Aug 08 17:20:25.834956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 845/1753] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:26.199806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:26.202034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:26.207999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.208478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.208911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.209593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.210066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.210489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.238125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5feafc84-eae3-425a-af9a-67602223f4f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Aug 08 17:20:26.238660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 909/1754] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:26.626556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:26.627153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:26.633513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.634026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.634456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.635132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.635575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.635990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.702159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:26.710619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:26.712116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:26.713251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ff52049b-218b-4aff-b90c-9958e55c56ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090993 Aug 08 17:20:26.713832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 846/1755] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:26.854162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:26.854714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:26.861255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.861740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.862214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.863042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:26.863516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:26.863969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:26.925164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:26.933041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e635a160-71a2-4b61-96ef-d80d8f70da32 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082816 Aug 08 17:20:26.933609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 910/1756] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:27.250174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:27.252926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:27.258852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.259343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.259780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:27.260465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.260917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.261372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:27.291628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c925606f-fcf9-4704-a273-6f7f9a035235 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Aug 08 17:20:27.292166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 847/1757] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:27.736321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:27.736933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:27.742857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.743337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.743783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:27.744468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.744921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.745345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:27.809587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:27.818626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:27.820126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:27.821261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e3b07073-f5dd-48bf-aa4d-70636caa0246 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089388 Aug 08 17:20:27.821903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 911/1758] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:27.953451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:27.954598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:27.960956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.961441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.961908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:27.962597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:27.963053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:27.963482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:28.024060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:28.031515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9dcfb57-ba4e-419c-8771-893ec75cdd2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081989 Aug 08 17:20:28.032074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 848/1759] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:28.304216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:28.306433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:28.312723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:28.313861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:28.314306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:28.314994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:28.315452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:28.315878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:28.344141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4b628203-af4a-458a-95a5-99f90a4362c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Aug 08 17:20:28.344682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 912/1760] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:28.842918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:28.843445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:28.849923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:28.850407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:28.850839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:28.851520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:28.851964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:28.852407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:28.912220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:28.920433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:28.921950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:28.923650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-815bb49c-9c5e-4509-9dba-93b945f19a26 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084646 Aug 08 17:20:28.924195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 849/1761] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:29.051919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:29.052578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:29.058773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.059243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.059684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:29.060366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.060820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.061283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:29.121050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:29.128532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b600e0ed-3133-44d2-925a-774e9668dfc5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080571 Aug 08 17:20:29.129098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 913/1762] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:29.355818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:29.358006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:29.364481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.364962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.365390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:29.366100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.366545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.366962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:29.396365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11513c32-7865-4c63-a8d2-439de58b6258 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Aug 08 17:20:29.396838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 850/1763] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:29.945805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:29.946438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:29.948765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=84 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:29.953513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.954035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.954472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:29.955166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:29.955620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:29.956049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:30.017286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:30.025730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:30.027290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:30.028435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bffea988-0d67-42f2-bc44-e5a4b4e15c7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086773 Aug 08 17:20:30.028986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 914/1764] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:30.150100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:30.150635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:30.157212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:30.157696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:30.158158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:30.158870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:30.159323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:30.159891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:30.219816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:30.223208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:30.227506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f639ccd1-ba1d-4070-8a93-fa66d4148931 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081402 Aug 08 17:20:30.228067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 851/1765] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:30.409137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:30.411250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:30.417168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:30.417659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:30.418120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:30.418803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:30.419282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:30.419701 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:30.447689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-78fb8e60-5e22-47cd-9144-4daecf56aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Aug 08 17:20:30.448210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 915/1766] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:31.050895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:31.051502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:31.058007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.058484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.058919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.059605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.060058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.060482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.123517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:31.132298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:31.133838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:31.134944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3fca399-a7bf-40b5-83b2-3c411f11f4a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088369 Aug 08 17:20:31.135487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 852/1767] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:31.248466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:31.249083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:31.255932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.256409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.256841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.257523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.258003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.258425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.318534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:31.325775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ff0031a0-caea-42bc-99e3-e3f717b8c829 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081179 Aug 08 17:20:31.326350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 916/1768] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:31.459936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:31.462194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:31.468121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.468607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.469043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.469726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:31.470200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:31.470622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:31.499409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc39b260-6004-43d7-9906-3556bffdab00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Aug 08 17:20:31.499951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 853/1769] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:32.158570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:32.159193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:32.165123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.168155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.168155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.168155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.168155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.168538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.231014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:32.239551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:32.241060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:32.242247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-32364046-a549-43df-b8af-3e22ed84d5f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088228 Aug 08 17:20:32.242892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 917/1770] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:32.346071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:32.346687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:32.353107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.353586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.354054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.354739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.355199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.355619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.416372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:32.424058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c6bb33ad-fcba-4c2b-8af1-7700ccf6bcc6 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082438 Aug 08 17:20:32.424644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 854/1771] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:32.512550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:32.515045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:32.522146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.522635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.523080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.523782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:32.524241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:32.524675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:32.549408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:32.553850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6974e4fb-e1ef-4993-9874-8184d601bd46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Aug 08 17:20:32.554445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 918/1772] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:33.264602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:33.266102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:33.271127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.271598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.272028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.272711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.273158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.273576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.333444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:33.341708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:33.343224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:33.344873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-273df380-08bd-4275-867a-164c8d6381ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084406 Aug 08 17:20:33.345418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 855/1773] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:33.444802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:33.445459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:33.451532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.452014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.452454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.453142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.453599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.454171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.514746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:33.522782 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a80cdbb3-d4a1-41d1-ba08-d41a9147a5db tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082200 Aug 08 17:20:33.523343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 919/1774] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:33.566084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:33.568234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:33.574686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.575164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.575599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.576280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:33.576729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:33.577176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:33.608952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-317d707c-eedf-4a49-9379-84f06f9477d5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Aug 08 17:20:33.609523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 856/1775] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:34.367133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:34.367756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:34.373747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.374255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.374691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.375978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.376435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.376861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.435850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:34.444934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:34.446478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:34.447629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a5d8902d-631c-4504-9bd5-0becf2615b66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084400 Aug 08 17:20:34.448188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 920/1776] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:34.543998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:34.544642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:34.551289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.551772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.552212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.552970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.553317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.553776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.617162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:34.620732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:34.623013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:34.624618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6170da19-e481-46fb-ab63-b62bb9ff22e1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084474 Aug 08 17:20:34.625781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 857/1777] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:34 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:34.630039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.630516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.630950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.631637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:34.632089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:34.632514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:34.669383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d81efaca-1fe6-41c5-82d1-3e61abfecbe4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052550 Aug 08 17:20:34.669961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 921/1778] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:35.471990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:35.472593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:35.478517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.478994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.479424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.480100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.480549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.480966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.543700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:35.552678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:35.554204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:35.555332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b219406b-e4b6-4298-bc5d-ecfb4f46f2b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087780 Aug 08 17:20:35.555877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 858/1779] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:35.646075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:35.646729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:35.653074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.653558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.654034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.654731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.655194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.655628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.681986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:35.684157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:35.690700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.691185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.691619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.692304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:35.692753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:35.693170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:35.716878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:35.722716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9ee274cc-49d8-493b-a191-383ec39407df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Aug 08 17:20:35.723225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 859/1780] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:35.724902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3d2a8021-c6c9-4039-833a-9bb0b675cac8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082717 Aug 08 17:20:35.725458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 922/1781] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:36.577585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:36.578240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:36.584224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.584707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.585143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.585858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.586310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.586736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.728798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:36.738068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:36.739566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:36.740793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e8f24c8f-e247-4cc9-bdc9-bd9eac9a6e02 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.167219 Aug 08 17:20:36.741588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 860/1782] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:36.745999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:36.746727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:36.753021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.753508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.753979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.754670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.755124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.755549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.811204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:36.813996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:36.815954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:36.819939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.820430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.820866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.821557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:36.822034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:36.822462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:36.823502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1b2c2e3-4519-47e6-94f0-baf716e978ea tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080932 Aug 08 17:20:36.824109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 861/1783] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:36.850135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e9a022d9-a592-491d-a824-5d642e86c2d7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119174 Aug 08 17:20:36.850601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 923/1784] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:37.825345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:37.826069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:37.832170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.832650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.833079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.833760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.834236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.834654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.844431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:37.844980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:37.851331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.851809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.852255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.852923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.853373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.853807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.896491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:37.904959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:37.907049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:37.908192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-acf6b068-31b0-4d56-a61f-fcbc78854156 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.148621 Aug 08 17:20:37.908906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 862/1785] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:37.914598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:37.916688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:37.921986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:37.923821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.924304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.924736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.925429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:37.925907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:37.926336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:37.957720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a332901-c6ea-4f53-baf1-92f9f017561d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047768 Aug 08 17:20:37.958303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 863/1786] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:37.962838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:37.970783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-675c571c-eb9a-457b-a321-aa950fa650f3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.130678 Aug 08 17:20:37.971326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 924/1787] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:38.931089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:38.931642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:38.938173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:38.938659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:38.939081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:38.939854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:38.940308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:38.940727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:38.970303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:38.972592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:38.979286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:38.979864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:38.980460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:38.981527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:38.981773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:38.982269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:39.005031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:39.011409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5fdbb969-0196-4b78-aa38-8352e6219a77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Aug 08 17:20:39.011975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 925/1788] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:39.014279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:39.016405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:39.017170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:39.017583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-992c5216-66f2-493b-9e2b-785e0a52d566 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090478 Aug 08 17:20:39.017808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:39.018359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 864/1789] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:39.023711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:39.024196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:39.024634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:39.025337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:39.025871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:39.026267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:39.088052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:39.096044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eea89f9b-acdf-4851-b65e-e862c46f8e87 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083122 Aug 08 17:20:39.096606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 926/1790] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:40.024477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:40.026675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:40.032938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.033418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.033884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.034565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.035011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.035435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.040378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:40.040988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:40.047321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.047799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.048230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.048919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.049382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.049824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.065037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-52b9b058-a0e5-40b4-9c37-c5b6d65db601 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 08 17:20:40.065587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 865/1791] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:40.110455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:40.115751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:40.116367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:40.118888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:40.120390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:40.121529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-066b2954-151f-4f62-b177-08311bc3bf40 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085047 Aug 08 17:20:40.122117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 927/1792] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:40.122279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.122667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.123097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.123784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:40.124233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:40.124652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:40.186351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:40.194277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0de7761c-83f0-4b35-bcf0-9e99de76b881 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082389 Aug 08 17:20:40.194832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 866/1793] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:41.077059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:41.079533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:41.085964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.086451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.086889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.087584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.088074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.088501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.116851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fa59bc6c-f2e6-4ceb-a04c-d5829811cfd7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Aug 08 17:20:41.117390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 928/1794] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:41.144554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:41.145169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:41.151731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.152210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.152649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.153331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.153798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.154231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.214523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:41.215502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:41.216119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:41.222044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.222530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.222963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.223129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:41.223652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:41.224106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:41.224529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:41.224628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:41.225731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a0a25e8e-20e0-45b1-bdeb-51e85d637dca tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085121 Aug 08 17:20:41.226307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 867/1795] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:41.285728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:41.293024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ffd4f949-a4d4-43b9-8d1a-98ddacf8ef77 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081302 Aug 08 17:20:41.293579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 929/1796] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:42.129194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:42.131508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:42.137397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.138167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.138607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.139288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.139746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.140170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.156860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:42.168775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c77b6ec5-aa54-4396-8394-b2ff0c34103a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 08 17:20:42.169317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 868/1797] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:42.248773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:42.249424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:42.256667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.257147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.257592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.258339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.258792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.259218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.314648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:42.315304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:42.321608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.322162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.326876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.327008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:42.327159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:42.327159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:42.327159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:42.332073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:42.333573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:42.334749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-75c661d5-cffe-4503-a278-a9d054dd6e45 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090184 Aug 08 17:20:42.335309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 930/1798] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:42.385936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:42.393753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e28af569-c865-497e-878f-0691eb33d15e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083575 Aug 08 17:20:42.394340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 869/1799] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:43.180295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:43.182545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:43.188485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.188963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.189398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.190111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.190568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.191002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.218267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8c9d1214-196b-4868-a5a6-19dd8285f212 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 Aug 08 17:20:43.219313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 931/1800] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:43.357971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:43.358580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:43.364978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.365455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.365926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.366606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.367055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.367481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.413849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:43.414466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:43.421159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.421680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.422145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.422834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:43.423289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:43.423710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:43.430963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:43.439447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:43.440938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:43.442177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1ad695b-23e2-4d03-b880-877af537a11d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088204 Aug 08 17:20:43.442721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 870/1801] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:43.485719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:43.493225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4740b411-b5ce-46cb-b160-bf91678b2064 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083193 Aug 08 17:20:43.493816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 932/1802] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:43 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:44.230899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:44.233077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:44.239600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.240080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.240516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.241193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.241644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.242096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.270889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3dd40547-bdf1-4924-ab22-16928bfd80b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Aug 08 17:20:44.271444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 871/1803] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:44.464535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:44.465254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:44.472133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.472614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.473100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.473737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.474218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.474643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.514020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:44.515249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:44.521672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.522201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.522632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.523323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:44.523772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:44.524190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:44.536750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:44.545222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:44.547386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:44.548527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-202b9b1b-63a6-46ad-b5ac-a37bfff99c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087971 Aug 08 17:20:44.549414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 933/1804] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:44.591319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:44.601275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6cf9471d-b545-470f-92fb-f5e28115665d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.091248 Aug 08 17:20:44.601863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 872/1805] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:45.283067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:45.285187 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:45.291092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.291581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.292017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.292698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.293157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.293582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.321779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ba753901-1075-411d-a37c-7dcb342f6c24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Aug 08 17:20:45.322342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 934/1806] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:45.571350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:45.571901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:45.578887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.579368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.579808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.580496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.580952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.581377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.621483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:45.622115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:45.628054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.628520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.628953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.629646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:45.630125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:45.630551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:45.646670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:45.655100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:45.655286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:45.656677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:45.657904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1e8ef6d-82d8-4d7c-8f9e-f079c85dd9b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090518 Aug 08 17:20:45.658463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 873/1807] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:45.698158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:45.706227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3db4a10a-fa1e-4a78-b938-dc12ebe53ea2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.088552 Aug 08 17:20:45.706876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 935/1808] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:46.334643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:46.336799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:46.342748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.343231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.344229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.344920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.345373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.345813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.374843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b77368d3-7e4a-4ff4-85d9-1a775f51cfd0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Aug 08 17:20:46.375378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 874/1809] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:46.680712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:46.681323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:46.688210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.688693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.689127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.689825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.690278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.690698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.727302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:46.727920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:46.733903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.734391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.734828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.735522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:46.736003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:46.736432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:46.755779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:46.764341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:46.766821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:46.767665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-368dfb99-cbb1-4de0-9895-97266d760874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090808 Aug 08 17:20:46.768219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 936/1810] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:46.796889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:46.804291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-021462fc-8ea2-4b76-a986-a002e3910ac9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080780 Aug 08 17:20:46.804845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 875/1811] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:47.386907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:47.389316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:47.395848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.396329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.396760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.397440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.397923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.398345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.426019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-868cbc13-9165-4f3a-9cb4-8ec95227be54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Aug 08 17:20:47.426565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 937/1812] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:47.789950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:47.790601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:47.797023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.797509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.797982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.798675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.799133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.799560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.824448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:47.827245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:47.832085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.832567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.833003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.833750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:47.834232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:47.834674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:47.863368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:47.871768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:47.873265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:47.874424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c10d0eb8-d066-4e3c-8907-84f46995c824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088438 Aug 08 17:20:47.874990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 876/1813] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:47.896503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:47.904041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-90c5207a-31a8-45da-845a-4f1a8f1fb032 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083441 Aug 08 17:20:47.904596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 938/1814] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:48.438514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:48.440581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:48.446498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.446978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.447412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.448093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.448543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.448963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.477263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8961a451-4987-40ae-bba4-94196aa9e00d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Aug 08 17:20:48.477811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 877/1815] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:48.897353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:48.897990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:48.904462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.904942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.905375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.906148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.906608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.907027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.924899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:48.925513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:48.931808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.932293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.932734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.933429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:48.933916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:48.934346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:48.967339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:48.975763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:48.977257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:48.978423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4bea1a6f-67fe-46c6-908a-e7372dab0bc4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084981 Aug 08 17:20:48.978993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 939/1816] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:48.995981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:49.004070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e100e98d-f54e-4aee-91ce-53e02763a9e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082974 Aug 08 17:20:49.004631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 878/1817] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:49.489525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:49.491737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:49.497623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:49.498140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:49.498582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:49.499274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:49.499774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:49.500733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:49.528947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bdf51d71-c22c-4e80-9e04-32726ba51e14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 Aug 08 17:20:49.529518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 940/1818] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:50.001133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:50.001734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:50.009877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.010370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.010803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.011495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.011946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.012630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.025592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:50.026237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:50.032619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.033106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.033567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.034282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.034740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.035184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.073951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:50.082509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:50.084002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:50.085162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b86d24c-8cfd-4c46-8e11-c03f4fc4a540 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088499 Aug 08 17:20:50.085715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 879/1819] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:50.096426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:50.103960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56c197d9-3d1b-4a1c-8928-d30d4523c1a3 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082317 Aug 08 17:20:50.104516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 941/1820] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:50.540724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:50.542903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:50.549399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.549912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.550349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.551025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:50.551476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:50.551901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:50.579572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b5f79784-f45f-43c2-9a4c-9cfcc0ff8cbc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Aug 08 17:20:50.580157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 880/1821] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:20:51.107486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:51.108098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:51.114439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.114923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.115354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.116037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.116522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.116946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.124287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:51.125390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:51.132048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.132209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.132625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.133315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.133770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.134217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.180744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:51.189452 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:51.190981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:51.192116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8f192548-3670-431f-80cc-2f2dccb64bac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088547 Aug 08 17:20:51.192843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 942/1822] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:51.195350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:51.202857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30fce3a6-7987-403d-b59e-552b0f001a72 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082390 Aug 08 17:20:51.203931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 881/1823] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:51.591811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:51.594093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:51.601077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.601565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.602031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.602721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:51.603175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:51.603594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:51.632605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a12c80eb-7c33-4e21-8516-6a81a7344cc3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 08 17:20:51.636521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 943/1824] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:52.214938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:52.215544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:52.222563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.223034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.223464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.224147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.224372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:52.224788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.224996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.225096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:52.232277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.232761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.237446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.237446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.237446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.237446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.291589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:52.297032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:52.300281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:52.301906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:52.303113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dbbeacae-f68c-4576-8e22-fadb9f53ae56 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.092127 Aug 08 17:20:52.303773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 882/1825] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:52.304687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56220162-3b9b-4880-9872-47290b221b9d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083979 Aug 08 17:20:52.305253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 944/1826] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:20:52.645253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:52.647440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:52.653398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.653983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.654423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.655106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:52.655557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:52.655980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:52.686501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9587a05e-314f-4708-b8e0-6127c34a8add tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045713 Aug 08 17:20:52.687550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 883/1827] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:53.324565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:53.325182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:53.325298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:53.325893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:53.331724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.332211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.332324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.332651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.332760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.333166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.333361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.333843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.333967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.334273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.334374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.334782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.395771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:53.395930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:53.403376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cacb651d-71cf-45bd-90fb-dc00181db4c5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082773 Aug 08 17:20:53.408278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 945/1828] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:53.408462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:53.408462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:53.408462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ba2b4765-2258-403a-ac28-e69400e32247 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086103 Aug 08 17:20:53.408767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 884/1829] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:53.699549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:53.701775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:53.707698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.708184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.708625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.709319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:53.709773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:53.710226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:53.739412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-105ae756-9d62-4cfc-8d87-f66c8afcd134 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Aug 08 17:20:53.740050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 946/1830] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:54.424368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:54.424983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:54.430087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:54.430708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:54.431737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.432217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.432733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.433402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.433873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.434299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.436748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.437720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.438183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.438874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.439090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:54.439330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.440151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.496104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:54.501707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:54.504356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a48b44cd-e9d5-4cb1-aea2-1a0221ba9825 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083878 Aug 08 17:20:54.505224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 885/1831] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:54 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:54.510193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:54.511698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:54.513092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-33e06aa7-3bc4-4928-97af-13b205ba9226 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086718 Aug 08 17:20:54.513637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 947/1832] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:54.752413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:54.754659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:54.760594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.761073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.761533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.762503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:54.762955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:54.763377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:54.791122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9599a87-e50a-4add-9159-e6ab80a8b7a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 Aug 08 17:20:54.791704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 886/1833] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:55.525631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:55.526274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:55.533228 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.533711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.534172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.534870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.535320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.535741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.536164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:55.536774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:55.543119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.543599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.544037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.544730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.545180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.545606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.599635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:55.607209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c4a28199-1158-4ac8-93a2-54f525ee25e2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085406 Aug 08 17:20:55.607678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:55.607811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 948/1834] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:55.616117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:55.617706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:55.618935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2cd709ce-7b05-4b83-a104-6c48360bdc2c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086687 Aug 08 17:20:55.619477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 887/1835] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:20:55.803464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:55.805640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:55.811548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.812528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.812967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.813659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:55.814143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:55.814573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:55.842606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8282e5a6-6ab5-4a3e-acff-f64663580ef3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Aug 08 17:20:55.843140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 949/1836] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:56.628601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:56.629219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:56.635673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.636156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.636594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.637575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.638063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.638522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.643543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:56.644199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:56.650435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.650917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.651353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.652042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.652491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.652914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.702096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:56.709530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5aa006ca-0a35-4a53-9b1f-e71eddc3f9b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085396 Aug 08 17:20:56.710127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 888/1837] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:56.713623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:56.722337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:56.723823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:56.724945 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-64ac0f41-56c3-421a-9ebe-ad5601ad6390 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085232 Aug 08 17:20:56.725476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 950/1838] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:56.854922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:56.857014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:56.862867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.863346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.863775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.864457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:56.864907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:56.865325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:56.895012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f3e1e261-5621-4ff7-a3e3-8b1957656b48 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Aug 08 17:20:56.895574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 889/1839] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:57.730700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:57.731315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:57.738285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.738765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.739217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.739884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.740332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.740755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.747371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:57.747985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:57.755123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.755620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.756060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.756755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.757270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.757700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.803362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:57.810820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b3dd6957-f54f-412f-9a63-26c3eb933341 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083920 Aug 08 17:20:57.811392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 951/1840] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:57.820750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:57.830116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:57.831614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:57.832739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc815b6c-331c-4bad-be93-ce4e48fb5ec6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089225 Aug 08 17:20:57.833285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 890/1841] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:57.907755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:57.909840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:57.915787 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.916275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.916723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.917410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:57.917910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:57.918341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:57.922548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:20:57.947477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b83ac009-0541-452e-b6ab-adcea3b052c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 08 17:20:57.948031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 952/1842] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:58.831950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:58.832556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:58.839145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.839566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.839993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.840672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.841122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.841541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.853883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:58.854506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:58.861853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.862336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.862770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.863460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.863916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.864341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.902824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:58.915841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27da31be-6be5-4028-8836-8b48eb71751a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087818 Aug 08 17:20:58.916416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 891/1843] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:20:58.925326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:58.933731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:58.935262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:20:58.936398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-37d83843-b3b0-45e6-90e0-4f100d141e14 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086457 Aug 08 17:20:58.936980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 953/1844] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:20:58.959411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:58.961545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:58.967547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.968528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.968966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.969648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:58.970135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:58.970568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:58.998822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e248c10e-81db-41b1-8f6c-5c2e50275105 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Aug 08 17:20:58.999369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 892/1845] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:20:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:20:59.937570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:59.938219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:59.944637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:59.945122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:59.945562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:59.946277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:59.946736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:59.947161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:59.958488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:20:59.959099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:20:59.965315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:59.965811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:59.966251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:20:59.966938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:20:59.967387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:20:59.967809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:00.011004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:00.019230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7d6e3832-839f-479c-8666-63eeebbdd8a9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086191 Aug 08 17:21:00.019914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 954/1846] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:20:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:00.024634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:00.026864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:00.028748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=82 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:00.030749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:00.034384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:00.034877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:00.035315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:00.036023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:00.036480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:00.036907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:00.039467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:00.051759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:00.051759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ef82e36-26bb-4d2e-8dbb-c9ad61766bdb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087409 Aug 08 17:21:00.051759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 893/1847] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:20:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:00.066167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ea1f84c5-b9dd-4363-95fb-48ca8b9c590e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Aug 08 17:21:00.066720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 955/1848] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:01.039710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:01.040323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:01.046747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.047222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.047653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.048328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.048774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.049191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.072516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:01.073194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:01.080640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.081146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.081583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.082295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.082748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.083170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.111920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:01.119346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9cc4bdd1-6fc1-40f8-9b22-515a79a2cc37 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083512 Aug 08 17:21:01.119903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 894/1849] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:01.124454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:01.127113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:01.133109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.133596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.134056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.134754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:01.135209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:01.135632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:01.157519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:01.165028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3a14da2c-fa6b-4859-a4e1-9096a8b4c3e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Aug 08 17:21:01.165586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 895/1850] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:01.165930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:01.167558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:01.168705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4ac10775-0cb8-4e2c-bd95-82f82bed47dc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.100199 Aug 08 17:21:01.169253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 956/1851] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:02.141251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:02.141884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:02.148486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.148968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.149406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.150198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.150652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.151073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.177074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:02.179242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:02.185887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.186386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.186831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.188180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.189127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.189127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.212621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:02.218390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e051c18d-fcbd-4e36-8c60-1c3f63efa69b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Aug 08 17:21:02.222805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 957/1852] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:02.222984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-04732830-f53e-430d-88e8-644ea1fa68ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084769 Aug 08 17:21:02.222984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 896/1853] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:02.223624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:02.224226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:02.231234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.231942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.232387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.233086 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:02.233572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:02.234137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:02.294905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:02.303691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:02.305189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:02.306376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1fd233f6-683b-4d89-81ae-a2535ac4927c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086514 Aug 08 17:21:02.306929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 958/1854] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:03.230675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:03.232846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:03.239335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.239811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.240247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.240937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.241390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.241829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.242856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:03.243472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:03.249670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.250692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.251125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.251810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.252261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.252683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.271618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd495bfd-a81d-431d-9841-387b98d08f89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 08 17:21:03.272364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 897/1855] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:03.315102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:03.322553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ce5278bb-c15d-4884-bba4-bf7eb96c8c04 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083476 Aug 08 17:21:03.323312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 959/1856] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:03.329003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:03.329613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:03.337022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.337022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.337022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.337022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:03.337449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:03.337901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:03.399877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:03.408195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:03.409678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:03.410837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b7f072c-4208-4dd0-ada7-582f17ce3042 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086348 Aug 08 17:21:03.411381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 898/1857] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:04.283665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:04.285903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:04.292262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.292744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.293185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.293914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.294372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.294798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.322112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-30631ebf-d602-4e25-bd29-ab7417c388d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Aug 08 17:21:04.322654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 960/1858] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:04.344231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:04.344847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:04.351182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.351691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.352123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.352804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.353253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.353672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.413125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:04.420652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6438718d-ec02-40ae-97d3-8ceabbd83388 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080920 Aug 08 17:21:04.421213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 899/1859] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:04.432386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:04.433006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:04.439222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.439639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.440076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.440767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:04.441227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:04.441649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:04.504834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:04.513426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:04.514970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:04.516615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-92cc2965-5463-42be-9c75-a1bc9e5cf313 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088133 Aug 08 17:21:04.517176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 961/1860] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:05.334122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:05.336246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:05.342225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.342709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.343141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.344318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.344793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.345169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.373581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81f9d2b1-5c02-430d-bbc4-b5b257487e54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Aug 08 17:21:05.374167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 900/1861] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:05.440443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:05.441057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:05.447409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.447889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.448324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.449009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.449463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.449914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.510522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:05.518230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-342bd20d-bf99-443a-9e40-b1ffe5ad291d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081643 Aug 08 17:21:05.518798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 962/1862] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:05 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:05.539031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:05.539765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:05.545656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.546172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.547286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.547915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:05.548355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:05.548773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:05.612449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:05.615854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:05.621232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:05.629736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:05.629736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5925a13-1b70-4ebc-abcc-07ebb861d947 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088738 Aug 08 17:21:05.629736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 901/1863] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:06.387473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:06.389596 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:06.396234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.396715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.397152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.397854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.398309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.398732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.426685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d08cb94e-de64-4def-bef2-f7db1f937185 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Aug 08 17:21:06.427222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 963/1864] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:06.539121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:06.539739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:06.546960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.547450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.547889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.548573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.549030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.549456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.610035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:06.617431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f918433-4a67-4ba9-a0f1-76dc09671a2a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082213 Aug 08 17:21:06.618027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 902/1865] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:06.654165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:06.654781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:06.661004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.661479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.661952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.662635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:06.663112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:06.663534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:06.723149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:06.731537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:06.733054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:06.734785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f375f692-6f39-480e-b749-d5c06973a3d6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083861 Aug 08 17:21:06.735339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 964/1866] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:07.439449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:07.441579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:07.447489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.447972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.448403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.449084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.449530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.449988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.477576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b686575f-884f-4921-bdff-897cea7ec6b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Aug 08 17:21:07.478154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 903/1867] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:07.638854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:07.639474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:07.645416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.645929 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.646369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.647061 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.647518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.647947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.707759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:07.715099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3e545528-4d8f-425b-9bec-b88885d4455f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080343 Aug 08 17:21:07.715660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 965/1868] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:07.756902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:07.757508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:07.764098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.764574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.765008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.765688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:07.766166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:07.766586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:07.826248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:07.835207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:07.836697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:07.837850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c2586db9-7ae4-4526-b920-e838172b4221 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084756 Aug 08 17:21:07.838408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 904/1869] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:08.490421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:08.492575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:08.498740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.499221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.499656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.500336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.500786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.501206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.529125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-77840832-6191-46a5-a8bc-2c5e0db8e022 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Aug 08 17:21:08.529662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 966/1870] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:08.738484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:08.739095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:08.744976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.745398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.745848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.746529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.746985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.747393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.806848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:08.814216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d9c0509-0a22-4522-b3a3-87294fa96884 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080179 Aug 08 17:21:08.814772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 905/1871] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:08.860347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:08.860957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:08.867286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.867760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.868194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.868874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:08.869352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:08.869776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:08.933936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:08.942272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:08.943759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:08.944886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-461c2a22-d1c0-49c8-8a11-a71143a2ab99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088450 Aug 08 17:21:08.945432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 967/1872] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:09.541880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:09.544104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:09.546069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:09.551188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.551751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.552110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:09.552800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.553256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.553681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:09.584705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d525baf3-dce5-4890-a83b-500c333a3135 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Aug 08 17:21:09.585263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 906/1873] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:09.834805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:09.835340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:09.841397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.841903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.842339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:09.843019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.843964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.844382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:09.968825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:09.969662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:09.976473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.976966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.977404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:09.978138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:09.978594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:09.979026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:10.046141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:10.053571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:10.056772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:10.058299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:10.058965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:10.059449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9ca6b3ea-54aa-4ac8-bbc0-d13dab25e224 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.095421 Aug 08 17:21:10.060002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 907/1874] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:10.063837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-230d29d0-1d49-4cfc-824a-e15fad355372 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.232849 Aug 08 17:21:10.064464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 968/1875] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:10.597220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:10.599435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:10.605333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:10.605845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:10.606287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:10.606976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:10.607431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:10.607855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:10.637358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bb38c8f6-59f5-48b5-a044-fe0928f77abf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 08 17:21:10.637941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 908/1876] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:11.081940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:11.082545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:11.084380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:11.085001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:11.088843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.089322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.089753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.090462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.090910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.091261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.091371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.091746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.092186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.092877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.093335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.093765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.152249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:11.155878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:11.160698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:11.162209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:11.162790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-86224d20-5905-4bd0-ac3b-b2ffd9be747e tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082403 Aug 08 17:21:11.163332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1a0dbc60-c6bc-493c-8b67-088bd58014ff tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085675 Aug 08 17:21:11.163437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 909/1877] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:11.163859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 969/1878] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:11.650495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:11.652692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:11.659002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.659478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.659910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.660595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:11.661042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:11.661464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:11.689901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f5048953-1320-4fcd-a5b9-6d402961378a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Aug 08 17:21:11.690454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 910/1879] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:12.182799 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:12.183433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:12.185509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:12.186148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:12.190530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.191058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.191500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.192200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.192790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.192921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.193726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.193841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.193841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.194547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.194859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.195272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.255124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:12.255672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:12.263575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b9019a93-f0ef-4d98-be4d-aa7daaf2b7c2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084506 Aug 08 17:21:12.264549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 970/1880] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:12.265041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:12.267307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:12.268488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6afe0da6-22b5-4899-963e-61aa2c35e186 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086870 Aug 08 17:21:12.269034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 911/1881] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:12.702182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:12.704363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:12.710348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.710837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.711282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.711978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:12.712434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:12.712876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:12.741226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b7921eea-34b4-4ccd-adef-5c7088fc36ff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Aug 08 17:21:12.741779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 971/1882] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:13.284814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:13.285582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:13.290575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:13.291194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:13.292068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.292555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.292995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.293700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.294241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.294668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.297982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.304991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.304991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.304991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.304991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.305438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.360722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:13.368391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1d52ca32-6d80-4575-9931-b783cf94bea5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087729 Aug 08 17:21:13.369197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 912/1883] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:13.372638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:13.381046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:13.382563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:13.383691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-808834fe-999e-495f-ac4c-47546c081074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.097347 Aug 08 17:21:13.384231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 972/1884] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:13.753348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:13.755523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:13.761671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.762183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.762625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.763304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:13.763749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:13.764168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:13.793524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5e4c9525-6b42-47b6-b00b-5a3c6bfc44c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Aug 08 17:21:13.794099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 913/1885] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:14.390024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:14.391143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:14.397606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.398121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.398563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.399251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.399742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.400164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.406726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:14.407342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:14.413652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.414161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.414590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.415302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.415748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.416166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.464355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:14.469239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-28bb4e05-8092-4461-a262-c891915f1256 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082674 Aug 08 17:21:14.469819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 973/1886] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:14.481260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:14.489761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:14.498762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:14.498762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d94d4660-b76a-4e52-8f15-9de243fae54b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090190 Aug 08 17:21:14.498762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 914/1887] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:14.806240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:14.808378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:14.814729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.815210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.815649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.816332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:14.816783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:14.817204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:14.846988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7dc30861-17d9-458f-8d0c-57b8fdb60589 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Aug 08 17:21:14.847513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 974/1888] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:15.489854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:15.490466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:15.497063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.497550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.498032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.498727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.499188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.499618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.518946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:15.519561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:15.525875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.526360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.526789 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.527478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.527923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.528343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.560944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:15.569329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f82b2ab1-6d6f-4249-8afc-65eeb6cdb018 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083441 Aug 08 17:21:15.570002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 915/1889] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:15.590258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:15.599006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:15.600536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:15.601706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cc312f20-cf3e-4d69-85a1-6d4aa8cf3e5f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087213 Aug 08 17:21:15.602289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 975/1890] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:15.861524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:15.863679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:15.869760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.870271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.870745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.871457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:15.872051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:15.872852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:15.902308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b6dacb8-0a9b-4e6c-b307-fc46029dcd10 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Aug 08 17:21:15.902866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 916/1891] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:16.589768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:16.590436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:16.597374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.597891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.598330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.599025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.599480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.599905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.624421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:16.625047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:16.630964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.631453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.631893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.632589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.633046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.633470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.660905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:16.668751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6f7092de-0068-4339-a87b-30d91cdabecf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082789 Aug 08 17:21:16.669322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 976/1892] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:16 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:16.695029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:16.704205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:16.705719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:16.706894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d892abc9-e53f-4ca6-a3bf-6fda141674de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086560 Aug 08 17:21:16.707448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 917/1893] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:16.914617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:16.916687 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:16.922626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.923115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.923560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.924249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:16.924717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:16.925171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:16.952516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1754f31c-a812-4ec2-a8ae-89b3ebcdb8a0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041860 Aug 08 17:21:16.953590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 977/1894] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:17.689652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:17.690294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:17.696677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.697188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.697629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:17.698348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.698805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.699230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:17.716766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:17.729806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:17.730420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:17.737222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.737700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.738162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:17.738851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.739300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.739719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:17.760016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:17.767820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb10164b-4a07-4e6e-a359-88857aca540f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082603 Aug 08 17:21:17.768387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 918/1895] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:17.804189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:17.813919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:17.815406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:17.816537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cde020d2-3275-4b10-bb06-4a88ade6114d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090648 Aug 08 17:21:17.817080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 978/1896] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:17.965030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:17.967213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:17.973142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.973621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.974094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:17.974784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:17.975238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:17.975662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:18.004311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-361f099a-f107-42d5-9f79-45a583c8e2d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Aug 08 17:21:18.004860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 919/1897] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:18.788818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:18.789436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:18.796007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:18.796504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:18.797502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:18.798301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:18.798758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:18.799184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:18.839621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:18.840166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:18.847113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:18.847601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:18.848040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:18.848736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:18.849189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:18.849612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:18.860030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:18.867597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7c6cca27-cf38-405b-b092-68f4369ba31b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082611 Aug 08 17:21:18.868169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 979/1898] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:18.913845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:18.922200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:18.923738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:18.924878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f393f6f-4fd7-4b85-8655-2186ef360ea5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089295 Aug 08 17:21:18.925434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 920/1899] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:19.017251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:19.019473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:19.025532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.026048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.033958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.033958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.033958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.033958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.056350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0210f588-e981-4ef2-9bec-a5a7384334cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Aug 08 17:21:19.056897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 980/1900] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:19.887565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:19.888139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:19.894609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.895093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.895530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.896221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.896676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.897103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.946986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:19.947613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:19.954151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.954843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.955078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.955783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:19.956243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:19.956674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:19.956896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:19.964394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-adbeb949-0fa2-424c-b4f3-8b24d8011b6a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081017 Aug 08 17:21:19.964954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 921/1901] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:20.018878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:20.027065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:20.028579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:20.029718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5586d7ec-f2f5-4f06-8a5d-c0cbb18617cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086645 Aug 08 17:21:20.030301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 981/1902] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:20.068341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:20.070576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:20.076484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:20.077059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:20.077499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:20.078279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:20.078732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:20.079156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:20.109659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9413e3b6-37a5-4750-b796-9cabd1d46718 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Aug 08 17:21:20.110286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 922/1903] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:20.985566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:20.986201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:20.992619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:20.993131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:20.993563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:20.994274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:20.994728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:20.995148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:21.053364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:21.054052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:21.057846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:21.060634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:21.061122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:21.061561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:21.062280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:21.062770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:21.063194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:21.065586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4079946a-f767-4a55-92fa-ce02ac783fdc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085082 Aug 08 17:21:21.066252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 982/1904] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:21.122010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:21.124260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:21.124858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:21.130993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:21.131479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:21.131953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:21.132652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:21.133109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:21.133539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:21.133743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:21.135346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:21.136773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5cfef17f-8dd8-409d-a7d8-484b68e8ee08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087349 Aug 08 17:21:21.138396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 923/1905] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:21.163935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a79d1195-301d-4473-950b-9eb8df3b5cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Aug 08 17:21:21.164593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 983/1906] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:22.085543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:22.086176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:22.092521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.093003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.093429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.094145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.094591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.095006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.155748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:22.165238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:22.165238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:22.165809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51c22827-6395-414a-af4d-475e3896784b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081728 Aug 08 17:21:22.165809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 924/1907] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:22.166332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.166819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.167260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.167964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.168416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.168842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.177105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:22.179334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:22.185300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.185813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.186358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.186951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:22.187405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:22.188374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:22.217172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3920244d-3bd8-43f7-b5a8-b68d38577538 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Aug 08 17:21:22.217873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 925/1908] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:22.234259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:22.243212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:22.244721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:22.245886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eabfab1a-7cd6-4af4-ab04-79dbda099655 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090845 Aug 08 17:21:22.246439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 984/1909] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:23.184517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:23.185147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:23.193328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.193830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.194267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.194952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.195401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.195818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.229865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:23.232088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:23.239179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.239667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.240109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.240811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.241265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.241688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.258030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:23.259039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:23.266904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63a68519-7ee5-4909-b85b-5df056629c02 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086269 Aug 08 17:21:23.267465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 926/1910] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:23.271915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:23.280062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b8ce6709-739d-4815-90ae-3f9078c4f8b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Aug 08 17:21:23.280198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:23.280285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 985/1911] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:23.280370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.280370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.280370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.280370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:23.280697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:23.280697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:23.341459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:23.350483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:23.351970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:23.353090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad9cc59a-ded8-4c4a-8502-ac0ea070a8c6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084736 Aug 08 17:21:23.353642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 927/1912] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:24.288497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:24.289016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:24.290566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:24.293203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:24.295628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.296119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.296558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.297757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.298256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.298686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.300347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.300839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.301285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.302019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.302479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.302910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.332140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-059363c3-f021-4cc1-ac9a-85e06f3c6a57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Aug 08 17:21:24.332706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 928/1913] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:24.358879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:24.366886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dcbf7a5d-15df-4273-b64f-b16323ca6abc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082702 Aug 08 17:21:24.367446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 986/1914] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:24.374794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:24.376079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:24.382019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.382494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.382950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.383636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:24.384094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:24.384521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:24.448702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:24.457028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:24.458584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:24.459726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1f8d2cfe-7599-483a-b51c-470c280f1eb8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088792 Aug 08 17:21:24.460279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 929/1915] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:25.344408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:25.346616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:25.352960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.353451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.353957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.354658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.355146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.355547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.384378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2a9db48b-dc67-49b3-8925-44482eb43369 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 08 17:21:25.384940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 987/1916] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:25.388464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:25.389080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:25.396870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.397348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.397828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.398521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.398967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.399387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.465876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:25.473443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-96f47527-f403-4ae3-8f89-499ab532d815 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.089197 Aug 08 17:21:25.474050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 930/1917] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:25.482475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:25.483095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:25.488914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.489422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.490124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.490820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:25.491277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:25.491705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:25.550815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:25.559069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:25.560510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:25.561644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6d65a498-b512-4b58-8b59-4acaa34c4adc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083101 Aug 08 17:21:25.562230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 988/1918] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:26.397035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:26.399236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:26.405882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.406983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.407422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.408123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.408577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.409001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.436905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-083a6f94-18b4-4f04-9ede-14f8f73c25cb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Aug 08 17:21:26.437495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 931/1919] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:26.493558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:26.494214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:26.500628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.501111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.501552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.502296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.502752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.503179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.565522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:26.572894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e236137a-5ec1-45ad-a582-42f7816616f7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083200 Aug 08 17:21:26.573449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 989/1920] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:26.585020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:26.585887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:26.591907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.592391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.592824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.593517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:26.594632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:26.595059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:26.657534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:26.665847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:26.667358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:26.668492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-205aedac-a256-4947-bf3a-4eba18e62ee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087496 Aug 08 17:21:26.669043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 932/1921] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:27.448954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:27.451135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:27.457125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.457608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.458075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.458764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.459222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.459650 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.489839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-123e2eda-3764-4eb2-895a-0e1188bd494a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Aug 08 17:21:27.490386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 990/1922] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:27.593299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:27.593939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:27.600277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.600753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.601183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.601895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.602346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.602761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.662667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:27.669915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-91f717ed-f03b-4fd2-a6e4-ba8f818503e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080423 Aug 08 17:21:27.670464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 933/1923] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:27 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:27.691502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:27.692155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:27.698466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.698946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.699424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.700065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:27.700517 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:27.700944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:27.760586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:27.769749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:27.771277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:27.772414 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-41529125-cb33-473c-bfef-b8f98a0223d0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085312 Aug 08 17:21:27.772967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 991/1924] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:28.502665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:28.504974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:28.511234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.511725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.512165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.512851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.513304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.513730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.542161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1670d1f2-503e-4fd8-a630-fa5f5c2a7a93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Aug 08 17:21:28.542716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 934/1925] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:28.690419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:28.691033 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:28.697427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.698014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.698364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.699055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.699515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.699941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.759342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:28.767462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-284de4f6-d042-4714-a1d2-d9cc6660a6dc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080912 Aug 08 17:21:28.768018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 992/1926] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:28.794404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:28.795186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:28.801495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.802001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.804718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.804718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:28.804718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:28.804718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:28.807816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:28.864378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:28.872676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:28.874197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:28.875322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ff52cc75-389a-4e37-b9e3-b51530daa2f9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084903 Aug 08 17:21:28.875871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 935/1927] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:29.555088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:29.557360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:29.563984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.564467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.564906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.565622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.566109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.566533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.594470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-24663e9a-a6c9-4393-beee-1d0016422c32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Aug 08 17:21:29.595035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 993/1928] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:29.787586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:29.788224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:29.794121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.794600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.795138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.795696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.796142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.797226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.857940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:29.865961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8c03ff9-4061-406f-a3e7-babd4402dc09 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082121 Aug 08 17:21:29.868049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 936/1929] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:29.897807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:29.898444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:29.905661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.906670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.907114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.907811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:29.908324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:29.908763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:29.967968 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:29.976914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:29.978447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:29.979595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b694212c-6ac9-48f3-95c7-5114f6e84fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085781 Aug 08 17:21:29.980148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 994/1930] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:30.606734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:30.608915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:30.617234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:30.617234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:30.617234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:30.617234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:30.617614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:30.617614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:30.646946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3dcc3b61-0c50-43da-8e2e-e6499da870c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Aug 08 17:21:30.647512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 937/1931] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:30.886572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:30.887116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:30.892957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:30.893441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:30.893913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:30.894604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:30.895059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:30.895485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:30.958042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:30.965637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6678158c-73d2-45bb-8125-262da5b51feb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083240 Aug 08 17:21:30.966262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 995/1932] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:31.002799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:31.003413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:31.009849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.010334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.011053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:31.011762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.012265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.012695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:31.077324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:31.085805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:31.087319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:31.088468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-95c6df01-c2bc-4eff-a0ea-121d59b8141a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090093 Aug 08 17:21:31.089024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 938/1933] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:31.659961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:31.662170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:31.664047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=82 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:31.668653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.669160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.669655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:31.670379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.670860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.671281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:31.699202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-59ace833-b579-4f98-9ec1-0415a7d9873a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Aug 08 17:21:31.699800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 996/1934] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:31.986194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:31.986803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:31.992745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.993224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.993667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:31.994378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:31.994839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:31.995261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:32.055522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:32.063501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-80760280-00c9-4e3c-914e-d266a9a7d4c8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081154 Aug 08 17:21:32.064062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 939/1935] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:32.111083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:32.111693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:32.118275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:32.118753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:32.119186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:32.119869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:32.120320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:32.120747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:32.185223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:32.194218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:32.196491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:32.196882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e02a37f0-7120-4884-acc7-1f6f178c4f8c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089844 Aug 08 17:21:32.197444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 997/1936] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:32.711941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:32.714219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:32.720748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:32.721232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:32.721663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:32.722365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:32.722815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:32.723236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:32.751974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81da8a4d-b490-4be6-b7d9-d6876d326dcf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Aug 08 17:21:32.752516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 940/1937] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:33.083839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:33.084464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:33.090450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.090939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.091379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.092105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.092565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.092999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.153516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:33.161593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4b983ff3-64c8-4511-b85b-8ecf414b4cb4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081655 Aug 08 17:21:33.162192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 998/1938] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:33.220598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:33.221201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:33.227541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.228017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.228447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.229126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.229571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.230019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.289815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:33.298034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:33.299523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:33.300643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e96c498-54df-4389-a64b-60a980a57f99 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084574 Aug 08 17:21:33.301187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 941/1939] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:33.764329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:33.767037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:33.772912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.773390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.773851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.774535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:33.775014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:33.775436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:33.803049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-69e61b7c-8408-4b6b-a625-bedff88b0260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Aug 08 17:21:33.803589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 999/1940] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:34.181958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:34.182570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:34.189058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.189533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.190009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.190685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.191141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.191559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.250989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:34.258385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-24c68e89-08cb-4a5d-bf56-6a58a4346d6d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080317 Aug 08 17:21:34.258940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 942/1941] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:34 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:34.322115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:34.322738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:34.329034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.329521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.330004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.330704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.331163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.331595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.391568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:34.399962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:34.401478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:34.402648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-88b846e2-a5fc-4f12-b0ff-678779f527c1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084364 Aug 08 17:21:34.403207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1000/1942] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:34.815184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:34.817425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:34.823395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.823878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.824319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.825006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:34.825467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:34.825925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:34.854998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e534a72-9bfb-4cf0-ba03-833b5828ec23 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 08 17:21:34.855536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 943/1943] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:35.278886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:35.279512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:35.285372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.285892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.286329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.287016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.287473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.287903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.350258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:35.357910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5a0b64ed-e5f6-4528-a67c-9af7d994a1f9 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082928 Aug 08 17:21:35.358911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1001/1944] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:35.425934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:35.426546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:35.432831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.433315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.433751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.434464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.434924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.435350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.497680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:35.506929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:35.508446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:35.509594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9042ad84-8e43-48da-83da-c8dfc1b741ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088078 Aug 08 17:21:35.510185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 944/1945] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:35.867236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:35.869353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:35.875337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.875824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.876268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.876962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:35.877425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:35.877879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:35.881396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:35.905974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dd91c5c2-199e-49b7-ac67-c1a3f9a3d87c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Aug 08 17:21:35.906522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1002/1946] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:36.379075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:36.379688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:36.385981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.386465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.386952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.387630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.388108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.388525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.451292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:36.459432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-421f1744-fc1b-4f7e-a51a-8b813328727d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084116 Aug 08 17:21:36.459928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 945/1947] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:36.531951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:36.532568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:36.539459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.539967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.540411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.541097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.541552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.542017 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.602134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:36.614826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:36.616372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:36.617527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f846471f-926f-493f-9034-9430b27ce16e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089502 Aug 08 17:21:36.618095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1003/1948] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:36.918381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:36.920580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:36.927008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.927485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.927948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.928626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:36.929108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:36.929525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:36.959228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-571bd7db-ad58-4c34-ac5d-c11792536e94 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Aug 08 17:21:36.959764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 946/1949] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:37.479649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:37.480394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:37.486955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.487441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.487882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:37.488573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.489032 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.489463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:37.548662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:37.556026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cb7ac365-ba4b-4486-8c08-712d167b8c1b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080275 Aug 08 17:21:37.556588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1004/1950] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:37 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:37.640473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:37.641592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:37.647978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.648458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.648892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:37.649577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.650055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.650482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:37.710431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:37.718707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:37.720852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:37.722032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a87bd903-75f8-4203-811c-ed0a77de90ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085399 Aug 08 17:21:37.722580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 947/1951] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:37.972073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:37.974299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:37.980151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.980629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.981062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:37.981747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:37.982224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:37.982644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:38.011464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f9bf0f90-6d8f-4b98-8d46-82e81c12c79b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Aug 08 17:21:38.011998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1005/1952] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:38.576394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:38.576996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:38.582976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:38.583452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:38.583884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:38.584591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:38.585040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:38.585478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:38.645328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:38.653083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-763f957b-4197-4ff3-b1de-40a4da263638 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080518 Aug 08 17:21:38.653635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 948/1953] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:38 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:38.744620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:38.745227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:38.751604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:38.752084 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:38.752516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:38.753192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:38.753641 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:38.754085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:38.815175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:38.823645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:38.825129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:38.826301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2cc17b23-4b2a-4f51-b6f9-9ae7a37e89c9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085534 Aug 08 17:21:38.826915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1006/1954] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:39.023530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:39.025686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:39.032194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.033336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.033980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.034685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.035144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.035572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.064779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2593271-0724-4f66-a502-785a53af6619 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Aug 08 17:21:39.065334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 949/1955] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:39.674021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:39.674635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:39.680587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.681066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.681497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.682210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.682659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.683079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.746060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:39.754166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d6c9f88f-9588-453b-8354-b6f3e7fdf0b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084533 Aug 08 17:21:39.754790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1007/1956] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:39 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:39.857155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:39.857155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:39.857155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=88 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:39.858124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.858124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.858124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.858782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:39.859226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:39.859689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:39.923063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:39.931261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:39.932745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:39.933898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-04ecdf36-32c6-460e-b98a-9a21d85e895c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088401 Aug 08 17:21:39.934445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 950/1957] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:40.076444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:40.079161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:40.085013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.085490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.085969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:40.086651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.087104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.087525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:40.116057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4aaf74d8-1b63-4c7a-b739-57189815f1e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Aug 08 17:21:40.116531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1008/1958] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:40.774675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:40.775288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:40.781174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.781655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.782127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:40.782813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.783266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.783690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:40.843133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:40.846665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:40.850973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ec4725ee-4572-407e-b5a6-6f88b651f365 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080215 Aug 08 17:21:40.851534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 951/1959] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:40 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:40.955828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:40.956492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:40.962867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.963344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.963776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:40.964478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:40.964927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:40.965347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:41.025159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:41.034362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:41.035888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:41.037272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-817abe17-d96a-4414-b622-c843e6ec94e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085053 Aug 08 17:21:41.037576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1009/1960] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:41.128572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:41.130706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:41.137298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:41.137774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:41.138230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:41.138908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:41.139361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:41.139780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:41.168098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0fad6428-912f-49c9-b1d3-ac598d408804 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Aug 08 17:21:41.168638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 952/1961] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:41.871864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:41.872398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:41.878742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:41.879220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:41.879679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:41.880359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:41.880806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:41.881223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:41.940156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:41.947454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4e06b9f0-2b9a-492a-892f-1df4e0a84a1c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079493 Aug 08 17:21:41.948008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1010/1962] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:41 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:42.059887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:42.060496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:42.066947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.067425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.067855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:42.068540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.068992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.069414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:42.129993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:42.138584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:42.140132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:42.141266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6227d1b3-946e-4f07-b83b-04380614094f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085270 Aug 08 17:21:42.141835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 953/1963] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:42.180954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:42.183184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:42.190207 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.192973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.192973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:42.192973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.192973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.193347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:42.221000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e7c04e95-d927-4880-8bb7-5e57f5a8cd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 08 17:21:42.221554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1011/1964] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:42.968143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:42.968758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:42.975265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.975747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.976182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:42.976869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:42.977318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:42.977739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:43.038232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:43.045614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f818137c-3c16-4fa6-84c3-67a0b553adab tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081382 Aug 08 17:21:43.046484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 954/1965] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:42 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:43.163727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:43.164348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:43.170359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:43.170847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:43.171291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:43.171978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:43.172435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:43.172865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:43.232769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:43.233277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:43.235043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:43.241184 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:43.241354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:43.241837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:43.242275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:43.242708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:43.242965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:43.243414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:43.243831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:43.243934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4ebee4e1-41f4-4f2e-87b0-e3b45ee755e3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084066 Aug 08 17:21:43.244384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1012/1966] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:43.273208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6c1dc6f4-f482-45eb-8f94-852902042d46 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Aug 08 17:21:43.273752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 955/1967] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:44.067007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:44.067622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:44.073510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.074022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.074460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.075142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.075598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.076016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.137631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:44.145559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-955e3663-868c-4ff2-ade1-5e51d14f501f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082916 Aug 08 17:21:44.146147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1013/1968] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:44 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:44.267289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:44.267912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:44.274327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.274808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.275242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.275927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.276381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.276804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.285058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:44.287267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:44.293488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.294007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.294446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.295129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:44.295582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:44.296063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:44.326056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bea8545a-d801-4495-9bbb-39d5b7e9b5e6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Aug 08 17:21:44.326542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1014/1969] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:44.345310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:44.353629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:44.355147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:44.356267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05acef27-a96e-415e-8247-78c0475fb671 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.093507 Aug 08 17:21:44.356812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 956/1970] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:45.165571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:45.166215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:45.172194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.172677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.173115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.173826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.174290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.174715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.234444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:45.241930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-854c7d55-334f-4e47-9024-4b742a360538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080196 Aug 08 17:21:45.242491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1015/1971] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:45 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:45.337663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:45.339820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:45.347043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.347528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.347964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.348646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.349128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.349553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.378114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c91a89c-257b-46be-a29a-c60584b07c74 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Aug 08 17:21:45.378666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 957/1972] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:45.378786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:45.379377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:45.387314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.387800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.388235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.388935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:45.389392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:45.389837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:45.451978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:45.460925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:45.462465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:45.463614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b39ce782-eb12-4370-b5df-1d85f9b79952 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088814 Aug 08 17:21:45.464179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1016/1973] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:46.263062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:46.263708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:46.269706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.270220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.270660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.271344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.271797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.272223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.331621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:46.339054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc450c1b-a280-4b54-a41a-cbe555d976e8 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080251 Aug 08 17:21:46.339608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 958/1974] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:46 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:46.389475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:46.391634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:46.397623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.398149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.398619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.399296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.399753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.400174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.428644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a97f0cff-2a86-4604-aeff-1c42e53539f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Aug 08 17:21:46.429196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1017/1975] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:46.485320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:46.485991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:46.492031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.492516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.492951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.493637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:46.494127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:46.494552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:46.554792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:46.563206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:46.564709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:46.565886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0962067-a17f-4d2c-91f7-c892ac266ab0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085014 Aug 08 17:21:46.566433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 959/1976] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:21:47.360615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:47.361262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:47.367205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.367680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.368115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.368797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.369246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.369666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.429824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:47.433188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:47.438276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-08e58552-c696-40b3-88e1-0ebe2b7e38ff tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081366 Aug 08 17:21:47.438838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1018/1977] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:47 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:47.442109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:47.444257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:47.450766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.451249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.451688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.452379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.452827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.453275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.481511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4399c4df-67bb-487a-99fe-69a02cf119d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 08 17:21:47.482087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 960/1978] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:47.589778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:47.590423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:47.596869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.597379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.597842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.598546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:47.599006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:47.599436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:47.662077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:47.670341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:47.672362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:47.673509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b2b8623-a98c-4725-806b-2a47bdcd2dcb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087687 Aug 08 17:21:47.674110 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1019/1979] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:48.458991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:48.459626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:48.466154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.466566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.467000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.467685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.468139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.468564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.494251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:48.496397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:48.503299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.503785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.504226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.504922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.505380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.505825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.529588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:48.535367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-977c9ca4-41aa-4477-b74e-75326a29d8bb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Aug 08 17:21:48.535935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1020/1980] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:21:48.537009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0e18ff78-4712-47b6-a417-4ef96476c673 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081785 Aug 08 17:21:48.537563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 961/1981] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:48 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:48.696111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:48.696722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:48.702682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.703783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.704221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.704912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:48.705367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:48.705808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:48.764532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:48.773547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:48.775079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:48.776221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-31f46a37-3d36-4ce8-abcb-29296fe351b7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083995 Aug 08 17:21:48.776773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1021/1982] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:49.548101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:49.550274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:49.556188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:49.556752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.556883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:49.557234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.557670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.558381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.558943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.559369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.563315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.563800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.564242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.564934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.565391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.565841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.588826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0fc5bcdf-ea5d-46fc-8d75-8cfe3396ddcc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Aug 08 17:21:49.589697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 962/1983] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:49.631255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:49.639027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b45c32e-2a74-4063-9943-434a703757ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.086639 Aug 08 17:21:49.639593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1022/1984] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:49 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:21:49.798658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:49.799193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:49.805009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.805480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.805941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.806615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:49.807153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:49.807569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:49.869203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:49.877441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:49.878955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:49.880114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6ab5321-e389-4338-8dd3-5bca822c7a6a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085384 Aug 08 17:21:49.880657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 963/1985] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:50.601646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:50.603889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:50.611030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.611511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.611949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.612642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.613088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.613511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.642542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a51e068c-fd55-4ce8-81da-428e693619ad tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Aug 08 17:21:50.643087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1023/1986] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:50.659756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:50.660367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:50.666762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.667241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.667676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.668361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.668814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.669238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.729565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:50.737602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5def3aa5-1d19-48ee-b7e1-4bf72d0bfd92 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081688 Aug 08 17:21:50.738193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 964/1987] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:50 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:50.902762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:50.903306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:50.909690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.911340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.911340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.911340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:50.911865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:50.912297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:50.972028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:50.980318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:50.981881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:50.983025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-afb28085-595b-4773-956f-014837727ba6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084345 Aug 08 17:21:50.983578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1024/1988] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:51.655263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:51.665965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:51.665965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:51.665965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:51.665965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:51.666790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:51.666790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:51.666980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:51.696742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3cd8a46f-2918-42a9-8370-625589ffb109 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Aug 08 17:21:51.697290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 965/1989] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:51.758053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:51.758670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:51.765321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:51.765810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:51.766259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:51.766947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:51.767399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:51.767821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:51.831800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:51.839180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-550d60ad-f7ba-4d2e-8495-938f335a0031 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084933 Aug 08 17:21:51.839673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1025/1990] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:51 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:52.005750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:52.006388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:52.012615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.013099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.013535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.014312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.014768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.015194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.234224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:52.249404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:52.251489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:52.252630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-91f2f227-9314-4bcf-b57c-700541afd053 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.250734 Aug 08 17:21:52.253175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 966/1991] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:52.709113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:52.711286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:52.717470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.718008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.718458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.719161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.719619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.720049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.748518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c9b61d1e-fa11-4408-9e13-c03a760c940b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 08 17:21:52.749085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1026/1992] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:52.860654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:52.861173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:52.867455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.867933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.868360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.869035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:52.869482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:52.869925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:52.935099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:52.943390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-34551e0d-ecb9-4fad-9562-67db8e07e063 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.087200 Aug 08 17:21:52.943934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 967/1993] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:52 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:53.279807 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:53.282927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:53.287396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.287899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.288344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:53.289030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.294798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.294798 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:53.353091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:53.361539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:53.363078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:53.364215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0a601df0-cc46-48c4-b92b-cf340d3850b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088371 Aug 08 17:21:53.364772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1027/1994] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:53.761642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:53.763821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:53.770389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.770875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.771315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:53.772013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.772472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.772901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:53.788989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:53.801423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1af1dad-d70b-4da0-b119-a28e639540ac tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 08 17:21:53.806349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 968/1995] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:53.966088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:53.966623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:53.973052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.973539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.974012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:53.974711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:53.975165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:53.975589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:54.049544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:54.057071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-58dfb2dc-9992-48b6-99e7-573e3149e8d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.095024 Aug 08 17:21:54.057632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1028/1996] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:53 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:54.388495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:54.389109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:54.395731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:54.396217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:54.396654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:54.397349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:54.397824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:54.398256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:54.460717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:54.469622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:54.471135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:54.472271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a4063d8c-8a32-4643-8ff8-a736687da84e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088315 Aug 08 17:21:54.472818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 969/1997] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:54.813092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:54.815198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:54.822023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:54.822513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:54.822958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:54.823667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:54.824125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:54.824555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:54.854595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7378000f-54c4-4966-b0c2-95662b57b123 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045494 Aug 08 17:21:54.855149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1029/1998] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:55.078218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:55.078751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:55.084688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.085168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.085609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.086326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.086776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.087224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.146985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:55.154413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1a6c5b2-a073-4230-9bab-03f184ba17e4 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080649 Aug 08 17:21:55.154978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 970/1999] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:55 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:55.494981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:55.495595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:55.502298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.502779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.503217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.503910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.504367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.504957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.574903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:55.583849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:55.585354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:55.586538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9545acf2-9881-45e3-8688-4a9e5d20f589 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.095496 Aug 08 17:21:55.587144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1030/2000] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:55.867167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:55.869196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:55.876173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.876653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.877083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.877766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:55.878232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:55.878648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:55.907075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f7804c3-f153-4f6c-9681-49a12d611289 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Aug 08 17:21:55.907620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 971/2001] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:56.176263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:56.176813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:56.183201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.183688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.184132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.184832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.185292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.185724 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.248568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:56.256072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3db8dae9-f2b9-4761-b01b-12e6c299f978 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084451 Aug 08 17:21:56.256637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1031/2002] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:56 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:56.608623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:56.609316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:56.615516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.616006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.616464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.617141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.617652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.618185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.681282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:56.690070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:56.691579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:56.692712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5c2c560-d89c-4f9e-a5cd-45b7540478bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088050 Aug 08 17:21:56.693264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 972/2003] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:56.919257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:56.921397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:56.927615 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.928104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.928545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.929248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:56.929703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:56.930152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:56.959368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-dcf5143b-849d-4868-9bd2-36980162f9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Aug 08 17:21:56.959981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1032/2004] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:57.276536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:57.277157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:57.283550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.284032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.284466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:57.285148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.285601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.286052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:57.345437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:57.352965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3cca3d47-b571-4755-8834-f79497ebbe58 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080262 Aug 08 17:21:57.353520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 973/2005] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:57 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:57.715505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:57.716119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:57.722905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.723385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.723816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:57.724505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.724954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.725375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:57.785011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:57.793245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:57.794753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:57.795881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a1e83f67-94ca-4563-a333-fb6b0694ae35 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084293 Aug 08 17:21:57.796461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1033/2006] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:57.971568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:57.973739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:57.979723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.980210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.980654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:57.981341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:57.981806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:57.982253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:58.011756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1f1e6a56-4c72-421a-8f08-fc1fb308fa54 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Aug 08 17:21:58.012293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 974/2007] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:58.374179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:58.374737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:58.380557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:58.381037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:58.381471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:58.382182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:58.382640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:58.383062 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:58.443112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:58.450417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-63c7fde4-4637-4acf-9bb3-b66d08bfa280 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080206 Aug 08 17:21:58.450978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1034/2008] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:58 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:58.817184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:58.817818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:58.824262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:58.824747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:58.825189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:58.825902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:58.826365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:58.826791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:58.889877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:58.898928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:58.900434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:58.901585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6dc77c1-2056-4be3-a57e-f49e4b383bb7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088278 Aug 08 17:21:58.902162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 975/2009] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:21:59.023813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:59.026003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:59.032426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.032918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.033367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.034089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.034554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.034988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.051683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:21:59.064711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7f2de0b5-abc3-404a-8f8d-433945133e53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Aug 08 17:21:59.067891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1035/2010] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:21:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:21:59.470753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:59.471394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:59.477271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.477761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.478233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.478927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.479390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.479818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.539376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:21:59.547369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f6744f1-8028-4e70-8523-94a6a80bd9b1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080517 Aug 08 17:21:59.547933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 976/2011] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:21:59 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:21:59.839234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:21:59.839987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:21:59.925004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:21:59.925613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:21:59.931837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.932312 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.932743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.933421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:21:59.933898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:21:59.934322 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:21:59.994121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:00.002409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:00.003928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:00.005060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-257290c8-9e5d-482f-a8d1-7ec9d12a7361 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084659 Aug 08 17:22:00.005607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1036/2012] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:21:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:00.078481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:00.080670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:00.087322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:00.087812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:00.088257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:00.088955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:00.089463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:00.089864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:00.119209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f40b235c-84af-4c99-b33c-47db9726fe06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Aug 08 17:22:00.119751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 977/2013] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:00.568165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:00.568781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:00.575111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:00.575590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:00.576030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:00.576717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:00.577166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:00.578218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:00.642833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:00.650242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e800e4e6-fcad-4859-bdcf-61a97232fe50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085857 Aug 08 17:22:00.654835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1037/2014] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:00 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:01.026952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:01.027530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:01.033504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.034010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.034441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.035118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.035565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.035982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.094959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:01.103179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:01.104699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:01.105843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9953b8eb-d5a6-4763-bc73-aebbae6efee5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.082813 Aug 08 17:22:01.106390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 978/2015] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:01.131555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:01.133730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:01.140360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.140854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.141298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.142026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.142509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.142934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.171808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-79dda42c-7bd4-4f54-a8dd-6660871342c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 Aug 08 17:22:01.172362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1038/2016] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:01.670651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:01.677055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:01.677256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.677588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.678054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.678732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:01.679178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:01.679600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:01.739143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:01.746562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84d4b413-8f7a-4bdd-a851-98b81aefe42d tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079780 Aug 08 17:22:01.747105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 979/2017] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:01 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:02.128291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:02.128913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:02.131293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=86 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:02.136247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.136730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.137170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.137893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.138371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.138832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.184401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:02.186353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:02.193574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.198839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.198839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.198839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.198839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.199276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.202333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:02.211610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:02.213117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:02.214297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-82af5751-ac21-4149-bd36-04dbb9cfd43b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090469 Aug 08 17:22:02.214854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1039/2018] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:02.227214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9de29f0a-e501-4679-ac39-599c2e9ffa43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047092 Aug 08 17:22:02.227767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 980/2019] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:02.767142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:02.767763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:02.773710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.774226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.774666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.775362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:02.775820 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:02.776248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:02.836758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:02.844718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-84ccc9f3-c0c5-480d-807c-5245705728e0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081616 Aug 08 17:22:02.845277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1040/2020] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:02 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:03.236542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:03.237163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:03.238812 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:03.240980 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:03.243727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.244221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.244665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.245364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.245844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.246271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.247306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.247795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.248235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.248927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.249384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.249835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.278749 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b607aac4-f022-45f5-9962-82269c2197e2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Aug 08 17:22:03.279306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1041/2021] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:03.310574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:03.318931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:03.320436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:03.321587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-02f60a5f-deb4-48f5-90e2-1e2ab3221146 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088996 Aug 08 17:22:03.322180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 981/2022] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:03.866743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:03.867279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:03.873605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.874111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.875139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.875835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:03.876287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:03.876711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:03.935547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:03.943509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9fa6a40-1dca-419c-a979-51d1c0ff160f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081798 Aug 08 17:22:03.944065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1042/2023] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:03 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:04.291559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:04.293712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:04.300671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.301146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.301574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:04.302291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.302738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.303155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:04.330844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bf412f3e-36ce-4247-9e73-cca1fb60091e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Aug 08 17:22:04.331371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 982/2024] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:04.344723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:04.345341 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:04.351698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.352174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.352611 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:04.353300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.353757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.354205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:04.418396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:04.429568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:04.431176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:04.432317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2839b2a0-eae5-4825-ba72-491787818e7f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091948 Aug 08 17:22:04.432868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1043/2025] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:04.963827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:04.964355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:04.970302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.970779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.971213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:04.971889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:04.972334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:04.972753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:05.032230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:05.039543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e598ea3d-9fe0-44ca-b02c-fbbfec3a666f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079688 Aug 08 17:22:05.040091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 983/2026] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:04 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:05.342828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:05.345046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:05.351313 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:05.351821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:05.352259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:05.352946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:05.353397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:05.353870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:05.383094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-44c3e08c-000a-483c-965d-620b29fcc5c5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 08 17:22:05.383693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1044/2027] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:05.454401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:05.455011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:05.461373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:05.461950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:05.462389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:05.463089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:05.463541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:05.463971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:05.524109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:05.532488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:05.533999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:05.535130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2c5fd92-4680-4db7-83d2-2a0cd670bbef tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084651 Aug 08 17:22:05.535675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 984/2028] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:06.059519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:06.060135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:06.066148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.066625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.067058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.067733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.068190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.068614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.127369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:06.134983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-85354647-13f3-4db0-b090-8da63b221d50 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079294 Aug 08 17:22:06.135535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1045/2029] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:06 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:06.395997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:06.398111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:06.404057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.404535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.404970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.406413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.406900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.407334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.411060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:06.435159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-88294cd0-ee0e-43b8-9da7-2f8df86d8683 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Aug 08 17:22:06.435697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 985/2030] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:06.557073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:06.557693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:06.564624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.565109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.565548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.566257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:06.566713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:06.567159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:06.627426 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:06.636052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:06.637553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:06.638715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bb346379-679d-484e-b237-cbdeba133293 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085588 Aug 08 17:22:06.639264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1046/2031] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:07.156082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:07.156699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:07.163221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.163707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.164147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.164838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.165299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.165726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.225508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:07.232868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8ad0fef-168e-48ee-b048-8e66f9c23722 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081047 Aug 08 17:22:07.234071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 986/2032] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:07 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:07.447859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:07.449984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:07.455885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.456370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.456813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.457497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.457986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.458417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.487214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e451d7de-eb5c-487c-ac17-3bb69db4d46f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Aug 08 17:22:07.487762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1047/2033] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:07.662355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:07.662972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:07.668917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.669409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.669872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.670569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:07.671025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:07.671453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:07.733580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:07.741892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:07.743402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:07.744549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3346c61f-6013-4cbd-a686-51c957eb58b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086164 Aug 08 17:22:07.745096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 987/2034] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:08.254443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:08.255070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:08.261743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.262254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.262692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.263370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.263827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.264248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.324047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:08.331453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-042efd28-7e8a-4dac-8721-784fde195538 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081391 Aug 08 17:22:08.332024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1048/2035] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:08 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:08.499511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:08.502274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:08.508707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.509467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.509936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.510630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.511085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.511514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.539641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-749b8c82-6b16-4d3a-ada0-62ec76b0b118 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 08 17:22:08.540176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 988/2036] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:08.766603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:08.767161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:08.773021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.773498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.773960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.774636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:08.775083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:08.775497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:08.837166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:08.845955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:08.847441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:08.848563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ca34408c-d91a-49a6-a3de-1c9f929ce278 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085932 Aug 08 17:22:08.849107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1049/2037] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:09.353308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:09.353867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:09.359781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.360315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.360745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.361425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.361909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.362329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.421375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:09.429085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc10640d-11aa-4b83-af22-1c750f4521b7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079731 Aug 08 17:22:09.429680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 989/2038] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:09 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:22:09.551756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:09.554002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:09.560372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.560855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.561293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.562012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.562493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.562920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.592493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb8c098b-9068-4f21-86d3-d7de8455a3a4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 08 17:22:09.593066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1050/2039] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:09.871251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:09.871855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:09.878918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.879397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.879824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.880501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:09.880949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:09.881368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:09.949733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:09.958057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:09.959555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:09.960682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a20149ae-174d-4e23-9072-9e2dcbbfa657 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.093311 Aug 08 17:22:09.961230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 990/2040] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:10.449925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:10.450553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:10.456546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.457038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.457480 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.458209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.458672 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.459102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.521658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:10.529118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b062acb5-808d-400c-882a-743533a3a8b0 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083106 Aug 08 17:22:10.529675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1051/2041] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:10 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:10.604635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:10.606861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:10.608727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=82 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:10.613375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.613891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.614327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.615009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.615463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.615881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.645355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2562005d-6652-46cb-9a37-f031adf93233 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Aug 08 17:22:10.645920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 991/2042] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:10.982878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:10.983494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:10.990158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.990644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.991076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.991758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:10.992209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:10.992627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:10.996522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:11.052539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:11.060886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:11.062422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:11.064050 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ace644b3-da3d-4869-8083-20d2727a9f66 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085072 Aug 08 17:22:11.064606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1052/2043] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:11.550889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:11.551491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:11.557698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:11.558199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:11.558631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:11.559334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:11.559785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:11.560205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:11.619877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:11.627954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8207224-c2e6-4adb-a987-77ecee893f6f tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081813 Aug 08 17:22:11.628538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 992/2044] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:11 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:11.657809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:11.660100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:11.666118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:11.666603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:11.667045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:11.667735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:11.668188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:11.668659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:11.697631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-183126c9-3f3d-4aae-bf61-eb4a22fe1d61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Aug 08 17:22:11.697904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1053/2045] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:12.086922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:12.087530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:12.093902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.095224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.095658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.096349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.096796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.097215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.160852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:12.169140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:12.170660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:12.171790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f372c80b-f09b-491c-ae5e-a0632469bf43 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089046 Aug 08 17:22:12.172430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 993/2046] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:12.648380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:12.648994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:12.655355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.655831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.656261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.656938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.657391 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.657835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.710982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:12.713159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:12.717107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:12.719672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.720165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.720608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.721298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:12.721751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:12.722203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:12.724825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6e973c27-040d-4842-b7d1-0918ea0c8109 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080288 Aug 08 17:22:12.725383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1054/2047] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:12 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:12.751205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c981f5b5-5f68-4c68-98aa-70c3b33c5d06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Aug 08 17:22:12.752085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 994/2048] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:13.194729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:13.195346 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:13.201331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.201843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.202287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.202973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.203430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.203854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.265470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:13.273735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:13.275253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:13.276389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62c1e427-6e9d-48b8-99d3-e296c343af72 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085559 Aug 08 17:22:13.276948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1055/2049] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:13.745418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:13.746055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:13.752461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.752943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.753383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.754095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.754585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.755011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.763857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:13.766553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:13.772892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.773378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.773840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.774536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:13.774991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:13.775415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:13.805466 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-48e97ce3-36e2-4c2c-b575-22bac94fea49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 08 17:22:13.813544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1056/2050] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:13.816179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:13.823651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8dbaeaf9-e661-4002-9b76-3bcfb20f40df tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082033 Aug 08 17:22:13.824203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 995/2051] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:13 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:14.299045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:14.299652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:14.305677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.306179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.306612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.307286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.307737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.308154 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.604185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:14.612565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:14.614129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:14.615268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3342347e-4ebc-45d0-a2fa-5ae629a4b42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.320089 Aug 08 17:22:14.615826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1057/2052] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:14.818311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:14.820440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:14.826787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.827266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.827701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.828464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.829645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.830178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.843871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:14.844418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:14.850664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.851148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.851588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.852281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:14.852737 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:14.853163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:14.858688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c08092d-c30c-47ea-a641-b5d7a46793e9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Aug 08 17:22:14.859249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 996/2053] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:14.912738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:14.920095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-64938521-7a4b-4c2f-9128-8fdd25007f79 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080156 Aug 08 17:22:14.920658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1058/2054] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:14 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:22:15.637842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:15.638395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:15.644319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.644795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.645251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:15.645971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.646423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.646846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:15.705867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:15.714104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:15.715597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:15.716726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4799baf9-5c57-45dc-bcaa-6d459a9e45d3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083108 Aug 08 17:22:15.717281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 997/2055] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:15.870607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:15.872814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:15.878891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.879374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.879809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:15.880488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.880940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.881363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:15.910133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c12167a6-2766-48f3-9dbf-0682b1efa757 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Aug 08 17:22:15.910605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1059/2056] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:15.940276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:15.940919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:15.947268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.947752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.948189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:15.948873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:15.949326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:15.949749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:16.009910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:16.017929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5976670e-84ff-41aa-8fa4-f84de41322d2 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081393 Aug 08 17:22:16.018481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 998/2057] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:15 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:16.739880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:16.740498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:16.746527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:16.747008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:16.747443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:16.748128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:16.748582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:16.749008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:16.810468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:16.819327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:16.820828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:16.821996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-62ce001a-65c9-4cdb-8d2f-e2a6fb61dd0b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086014 Aug 08 17:22:16.822558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1060/2058] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:16.922749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:16.924828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:16.930930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:16.931420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:16.931863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:16.932558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:16.933017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:16.933452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:16.961266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-356245c1-b934-4acf-a329-8a772d00c6f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Aug 08 17:22:16.961887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 999/2059] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:17.038438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:17.039054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:17.045383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.045891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.046329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:17.047658 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.048127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.048556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:17.107412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:17.115380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-59e8b743-5a2b-4f81-b1b1-700df3ecb9e5 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080753 Aug 08 17:22:17.115944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1061/2060] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:17 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:17.844377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:17.844898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:17.850975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.851453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.851890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:17.852570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.853023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.853444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:17.915518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:17.923743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:17.925241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:17.926405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-36a5ac0b-f865-4fae-b8a3-a4290f642dc1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086084 Aug 08 17:22:17.926954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1000/2061] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:17.973340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:17.975548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:17.981424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.981936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.982376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:17.983063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:17.983522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:17.983947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:18.012156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-09c46ee7-8848-44a3-bf9f-cc8a5af85e66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Aug 08 17:22:18.012695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1062/2062] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:18.135886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:18.136447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:18.142773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:18.143260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:18.143695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:18.144378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:18.144834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:18.145256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:18.205852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:18.209173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:18.213414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bb4af706-8f08-4911-8080-556cdea6ea16 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081721 Aug 08 17:22:18.213998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1001/2063] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:18 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:18.949323 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:18.949882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:18.956804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:18.957280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:18.957713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:18.958418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:18.958870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:18.959294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:19.023241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:19.024999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:19.027192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:19.032544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:19.034119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:19.035272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c9609678-80b6-44ea-9c5a-15e726920191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089958 Aug 08 17:22:19.035626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:19.035832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1063/2064] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:19.036115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:19.036626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:19.037335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:19.037809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:19.038267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:19.069707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf5f74ae-acc4-4110-90fb-88cb55832ba2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048659 Aug 08 17:22:19.070290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1002/2065] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:19.233743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:19.236547 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:19.240366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:19.240853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:19.241295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:19.242022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:19.242484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:19.242911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:19.302579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:19.309817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7ef6cae7-d202-493a-a8c4-ef3a0f74c564 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079912 Aug 08 17:22:19.310381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1064/2066] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:19 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:20.057730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:20.058368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:20.064824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.065340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.065776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.066490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.066940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.067361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.082496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:20.085852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:20.092264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.092748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.093181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.094405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.094859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.095278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.124470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3a551a9-a588-49f3-abad-059ea9b37eb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046447 Aug 08 17:22:20.125028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1065/2067] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:20.133031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:20.141614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:20.143142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:20.144271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e1ebcf3-983b-4343-aa75-5d8e0bcf7517 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090493 Aug 08 17:22:20.144812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1003/2068] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:20.330960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:20.331508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:20.337382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.337897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.338333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.339012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:20.339463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:20.339886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:20.398977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:20.406374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2dda5333-4134-43ee-b94a-a84df1be314b tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079682 Aug 08 17:22:20.407440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1066/2069] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:20 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:21.137410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:21.139856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:21.146374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.146960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.147461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.148178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.148643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.149072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.166933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:21.167553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:21.174609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.175111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.175613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.176315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.176770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.177199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.177934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7bdf6892-f0b7-4e2e-81c4-74327b751f01 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Aug 08 17:22:21.178486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1004/2070] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:21.237395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:21.245714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:21.247257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:21.248397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5ad5a6b8-bf0a-4d46-96dd-7e2b9a1c3ea8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085376 Aug 08 17:22:21.248959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1067/2071] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:22:21.427673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:21.428216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:21.434055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.434536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.434964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.435638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:21.436083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:21.436501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:21.495504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:21.502840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-69c4f13a-849b-419f-bb97-103d82842088 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.079043 Aug 08 17:22:21.503397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1005/2072] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:21 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:22.189764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:22.191936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:22.198357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.198841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.199302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.199961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.200401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.200822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.225285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:22.229704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-138a8ad9-9d70-4805-8395-493d3f1df63e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 08 17:22:22.230305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1068/2073] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:22.272060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:22.272674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:22.279208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.282521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.282521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.282521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.282521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.282898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.344335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:22.352962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:22.354523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:22.355700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-37b01250-8b3f-4d20-9952-cbf9de5775e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087566 Aug 08 17:22:22.356249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1006/2074] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:22:22.523974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:22.524518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:22.531011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.531490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.531924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.532607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:22.533059 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:22.533478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:22.597514 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:22.605231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5e872359-0e11-42ab-87c6-3aa5745ee54a tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.085374 Aug 08 17:22:22.605815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1069/2075] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:22 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:23.241963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:23.244101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:23.250042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.250526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.250957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.251638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.252089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.252512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.280823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-83aa4949-9275-4c60-bfcc-6152632c7ad2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042881 Aug 08 17:22:23.281470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1007/2076] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:23.377561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:23.378201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:23.385524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.386045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.386486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.387174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.387630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.388054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.448433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:23.456874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:23.458407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:23.459550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7b61b912-9aa7-4890-a8dd-2500dc96f0e8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085935 Aug 08 17:22:23.460100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1070/2077] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:23.626814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:23.627421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:23.633319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.634096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.634528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.635214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:23.635661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:23.636080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:23.695029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:23.702318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fbfb5fb3-2c39-45d3-b319-fcf7f4f65446 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080124 Aug 08 17:22:23.702869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1008/2078] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:23 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:24.292577 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:24.294739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:24.301182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.301665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.302137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.302823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.303279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.303734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.332449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-026a66a2-61d0-4b58-b9be-948382d6b89e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Aug 08 17:22:24.333004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1071/2079] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:24.481416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:24.481995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:24.489000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.489483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.489966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.490665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.491117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.491540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.555010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:24.563421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:24.564918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:24.567205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-58396953-8e28-4032-9714-37922dcb0525 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089745 Aug 08 17:22:24.567944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1009/2080] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:24.723166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:24.723815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:24.730221 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.730706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.731144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.731888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:24.732296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:24.732725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:24.809444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:24.816982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-44ccb82f-ef23-494e-9e66-9acb693d6edb tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.098191 Aug 08 17:22:24.817553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1072/2081] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:24 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:25.344630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:25.346865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:25.352911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.353401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.353866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.354632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.355126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.355554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.384618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63c65725-d10c-4f6f-b014-75d11641c6ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 08 17:22:25.385166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1010/2082] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:25.589715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:25.590090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:25.596132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.596647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.597077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.597755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.598236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.598657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.658431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:25.666628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:25.668112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:25.669230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1a04004e-dbd7-48b9-9ebe-4285a0ed2185 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083775 Aug 08 17:22:25.669781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1073/2083] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:25.837973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:25.838592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:25.845043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.845529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.846005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.846743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:25.847159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:25.847591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:25.907765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:25.915193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fd3ce59f-4a4b-49b1-9eed-d4a8ba2f52ed tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081128 Aug 08 17:22:25.915767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1011/2084] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:25 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:26.397068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:26.399267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:26.405748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.406264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.407321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:26.408011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.408468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.408901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:26.437342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-29ff200e-f35a-4e77-ba73-84468538b325 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 08 17:22:26.438027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1074/2085] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:26.692300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:26.692907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:26.698872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.699352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.699780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:26.700461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.700907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.701325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:26.763552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:26.772520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:26.774036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:26.775549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7259333b-1ec6-448b-94f0-699c9348f1eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087589 Aug 08 17:22:26.776105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1012/2086] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:26.936245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:26.936868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:26.943450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.943939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.944380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:26.945067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:26.945523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:26.945988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:27.005520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:27.013245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-16a1c35b-285a-440d-9545-fde19e7a505c tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080909 Aug 08 17:22:27.013823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1075/2087] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:26 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:27.449497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:27.451652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:27.457849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:27.458329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:27.458763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:27.459443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:27.459894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:27.460312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:27.489012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fffd1a32-27da-4aa9-8d28-739b64cf7789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Aug 08 17:22:27.489548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1013/2088] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:27.797259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:27.797934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:27.804367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:27.804855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:27.805298 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:27.806020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:27.806482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:27.806913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:27.870389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:27.878822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:27.880362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:27.881500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-de637be3-bcf1-4282-8ff4-c5a871a27a25 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088182 Aug 08 17:22:27.882101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1076/2089] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:28.034939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:28.035554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:28.041522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.042228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.042477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.043231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.043689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.044114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.103581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:28.111205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db9a156c-2cb9-4fc4-a3e8-71a7efb8e261 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080734 Aug 08 17:22:28.111765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1014/2090] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:28 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:28.501060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:28.503269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:28.509476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.509999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.510447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.511140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.511603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.512074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.540458 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aa36dfc1-fe23-4fb0-ba3a-4bd254b5fa2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Aug 08 17:22:28.541014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1077/2091] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:28.904395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:28.904933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:28.911862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.912343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.912781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.913468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:28.913950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:28.914404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:28.973935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:28.982171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:28.983672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:28.985434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-511d4663-664c-47b1-9ecf-863bebc30165 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085114 Aug 08 17:22:28.986023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1015/2092] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:29.130515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:29.131129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:29.137813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:29.138302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:29.138739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:29.139421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:29.139876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:29.140296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:29.201520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:29.210891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f7f5e987-374b-43ea-8137-ee7fd39996dd tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.084247 Aug 08 17:22:29.211459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1078/2093] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:29 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:29.405521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:22:29.405687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:22:29.552507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:29.554686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:29.560588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:29.561064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:29.561498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:29.562212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:29.562662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:29.563083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:29.591236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ffa0ca4-ed03-4aac-90e4-ebe4a823cc7c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Aug 08 17:22:29.591791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1016/2094] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:30.007685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:30.008558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:30.014494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.014970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.015402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.016660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.017109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.017530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.079190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:30.088020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:30.089508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:30.090670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-61e9b192-2076-4e73-8fb2-177e55eaee1f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086918 Aug 08 17:22:30.091244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1079/2095] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:30.231865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:30.232477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:30.239371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.239850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.240281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.240964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.241410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.241855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.301977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:30.309172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-36c87fc1-72a6-497c-b9cf-d3f274765918 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.081287 Aug 08 17:22:30.309723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1017/2096] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:30 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:30.604370 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:30.606554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:30.613612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.614163 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.614590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.615276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:30.615735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:30.616162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:30.644361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-84d2aaba-db20-491b-adf8-e6bfeba6e9f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Aug 08 17:22:30.644900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1080/2097] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:31.113544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:31.114180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:31.120939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.121428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.121895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.122590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.123047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.123500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.143804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:31.190254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:31.198658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:31.200188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:31.201329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e6b6afd-e236-4ad6-82f1-278006118841 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.092203 Aug 08 17:22:31.201902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1018/2098] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:31.330660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:31.331283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:31.337297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.337828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.338272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.338956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.339416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.339847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.399634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:31.407619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f28eda3b-2293-40e5-96fb-bef5ba155c85 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080885 Aug 08 17:22:31.408182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1081/2099] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:31 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:31.657282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:31.659399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:31.665754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.666275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.666718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.667406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:31.667862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:31.668288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:31.696104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53e99de1-d7a2-4eac-ab5b-4ade53e7ccee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Aug 08 17:22:31.696640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1019/2100] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:32.223124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:32.223764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:32.226093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=86 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:32.230758 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.231240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.231683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.232360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.232814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.233239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.296543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:32.305371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:32.306927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:32.308077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9b288d0c-f1ad-4c91-8633-6534a81cfd83 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088891 Aug 08 17:22:32.308628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1082/2101] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:32.428052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:32.428662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:32.434556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.435042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.435467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.436145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.436588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.437005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.496191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:32.504485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-61532256-51d7-4ab9-9eb3-e851a3baae33 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080216 Aug 08 17:22:32.505031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1020/2102] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:32 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:32.708281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:32.710483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:32.716476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.716961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.717400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.718115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:32.719233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:32.719487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:32.748004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-282f09dd-2e73-41a8-9599-ee53076b3054 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Aug 08 17:22:32.748558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1083/2103] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:33.331020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:33.331628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:33.338036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.338517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.338950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.339636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.340093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.340517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.401077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:33.410670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:33.412240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:33.413377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7aa1c585-32ab-477d-81e4-fd8532f3ae7c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086312 Aug 08 17:22:33.413956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1021/2104] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:33.524358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:33.524985 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:33.531989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.532474 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.532916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.533611 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.534096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.534527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.595655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:33.603181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-72efaffe-7d7f-4a87-a93d-662325da8bf7 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.082706 Aug 08 17:22:33.603774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1084/2105] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:33 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:33.760544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:33.762705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:33.769145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.769626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.770095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.770788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:33.771246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:33.771673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:33.799951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc29df24-0b7a-405f-8526-8ea5de3dff89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Aug 08 17:22:33.800487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1022/2106] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:34.436507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:34.437115 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:34.443661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.444136 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.445275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.446283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.446757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.447196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.465765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:34.508380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:34.517542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:34.519173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:34.522018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-95271fa2-35a6-4dea-9b3a-41253347a3e9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087740 Aug 08 17:22:34.522018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1085/2107] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:34.624573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:34.625780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:34.632276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.632788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.633488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.634220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.634676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.635104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.696813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:34.704334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90c99ea8-8421-4b37-b21b-97f7acb13bcf tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.083793 Aug 08 17:22:34.704895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1023/2108] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:34 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:34.723676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:34.724197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:34.730837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.731316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.731747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.732424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.732872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.733291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.761335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Going to try to terminate instance {{(pid=130500) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:22:34.812986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:34.815198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:34.821089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.821574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.822072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.822793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:34.823255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:34.823686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:34.851718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cd3f5456-51a5-4403-bb82-8abd0621df95 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Aug 08 17:22:34.852261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1024/2109] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:35.031433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-57713604-1f36-4313-ace2-feb25e57700b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 204 len: 0 microversion: 2.1 time: 0.310650 Aug 08 17:22:35.031932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1086/2110] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:22:34 2022] DELETE /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:22:35.040063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:35.040709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:35.047294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.047777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.048217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.048928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.049384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.049828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.177960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:35.185743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-629f1855-085c-4e40-9639-19f37855a3b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149508 Aug 08 17:22:35.186351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1025/2111] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:35 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:22:35.543077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:35.543775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:35.549711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.550229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.550667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.551350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.551805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.552233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.612696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:35.621072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:35.622600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:35.623732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f0fccc60-12c0-48ea-bec8-2c9b80d92191 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085009 Aug 08 17:22:35.624284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1087/2112] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:35.724815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:35.725424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:35.731757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.732235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.732667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.733346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.733811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.734232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.794212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:35.801623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-602fa23d-d74f-4791-8326-8866628106cc tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080642 Aug 08 17:22:35.802204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1026/2113] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:35 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:35.863871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:35.865996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:35.872334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.872818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.873258 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.873977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:35.874434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:35.875349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:35.903818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-28c385e8-6b62-4d18-ae1a-d8dcc5a8b18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Aug 08 17:22:35.904358 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1088/2114] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:36.206944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:36.207505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:36.213456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.213962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.214393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.215068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.215516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.215934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.346047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:36.353763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5be8f43a-bb52-4ea5-9cad-6c0b670abdd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150775 Aug 08 17:22:36.354341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1027/2115] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:36 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:36.646130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:36.646740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:36.652597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.653075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.653506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.654208 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.654657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.655078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.716607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:36.725296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:36.726809 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:36.727938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-87911084-cc9d-4015-974c-8cf70fcc9e41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086088 Aug 08 17:22:36.728491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1089/2116] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:36.822408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:36.823015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] [instance: e68ae2a9-75e7-4eba-b349-a5207bc78db2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:36.829858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.830334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.830762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.831459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.831905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.832320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.892253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563998855204d3881af170730f04a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42851a2730ad4d749d5e33d44ea607e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:36.899534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cac7d38c-3d95-4422-a465-e75b0ba263d1 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2" status: 200 len: 1214 microversion: 2.1 time: 0.080946 Aug 08 17:22:36.900116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1028/2117] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:36 2022] GET /compute/v2.1/servers/e68ae2a9-75e7-4eba-b349-a5207bc78db2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:36.915771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:36.918116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:36.924450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.924937 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.925395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.926090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:36.926546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:36.926970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:36.956107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-809a5346-f625-401d-a35e-59cc4d510ca5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Aug 08 17:22:36.956666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1090/2118] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:37.138000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05e38539-d291-41f6-92aa-f8fdfb8bd980 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] Calling method '.version_select at 0x7f743d164c10>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:37.226158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05e38539-d291-41f6-92aa-f8fdfb8bd980 tempest-TestShelveInstance-1515830254 tempest-TestShelveInstance-1515830254-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1422761939" status: 202 len: 0 microversion: 2.1 time: 0.091870 Aug 08 17:22:37.226731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1029/2119] 10.222.0.57 () {58 vars in 1254 bytes} [Mon Aug 8 17:22:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1422761939 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:22:37.376188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:37.376805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:37.382647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.383394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.383827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:37.384511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.384956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.385375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:37.513282 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:37.521947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-79c60ed8-057a-43c4-a5d9-01dc9ab4eadb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150006 Aug 08 17:22:37.522510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1091/2120] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:37.755188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:37.755807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:37.762071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.762558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.762995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:37.763688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.764190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.764643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:37.844550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:37.853097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:37.854642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:37.855786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-550b2968-e1be-4eda-81fd-e995c70c9ca3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.104640 Aug 08 17:22:37.856342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1030/2121] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:37.969020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:37.971244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:37.977601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.978152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.978582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:37.979286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:37.979779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:37.980211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:38.009836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9703ffa8-6104-4e9e-9cc3-5701ca893acd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Aug 08 17:22:38.010326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1092/2122] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:38.608901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:38.609519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:38.615470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:38.615954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:38.616433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:38.617146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:38.617774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:38.618228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:38.816116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:38.824641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3d1f7f5f-5d8a-470e-a79e-def86e778d8b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.285586 Aug 08 17:22:38.825449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1031/2123] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:38.879205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:38.879902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:38.894189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:38.894703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:38.895153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:38.895883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:38.896345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:38.896768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:38.959040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:38.968666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:38.970213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:38.971371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-efb1c7e6-2655-4643-b78b-0509d7e3d7a0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.096748 Aug 08 17:22:38.971936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1093/2124] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:39.023071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:39.025535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:39.032094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:39.032581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:39.033026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:39.033727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:39.034212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:39.034638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:39.064340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-94cc1028-73c3-4429-991c-aaff9e0ec659 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 08 17:22:39.064904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1032/2125] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:39.847496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:39.848152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:39.854652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:39.855138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:39.855581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:39.856270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:39.856731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:39.857162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:39.992524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:39.993403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:39.994616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:39.999859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:40.000435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:40.001072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:40.001999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:40.002644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:40.002832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-790b13da-ecb7-41e9-8fd4-327d6f6583e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.159770 Aug 08 17:22:40.003347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:40.003467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1094/2126] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:40.076767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:40.079962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:40.086200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:40.086700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:40.087188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:40.087884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:40.088536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:40.088776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:40.089034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:40.099253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:40.100753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:40.101944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0cb919f9-24f8-4f52-92f4-f9de7db95f31 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.113263 Aug 08 17:22:40.117187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1033/2127] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:22:40.123533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-37862762-ea58-4838-b127-f2bfeeb29c85 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050814 Aug 08 17:22:40.124119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1095/2128] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:41.028763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:41.029613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:41.037418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.038462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.039070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.040337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.041570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.042885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.124783 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:41.125386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:41.132460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.133199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.133630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.134410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.134869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.135332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.199443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:41.208949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:41.210477 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:41.212353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5286783a-4375-4236-b627-66c0a0523a51 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091628 Aug 08 17:22:41.212943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1096/2129] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:22:41.217700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:41.220673 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:41.226605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.227375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.227808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.228502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:41.229644 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:41.230121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:41.262044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eae0ed5c-6e68-4a3f-9565-5d53fa097f80 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048034 Aug 08 17:22:41.262602 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1097/2130] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:41.271893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:41.297128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae0bcea9-7a46-4dd8-88d5-a3e675cf7184 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.259807 Aug 08 17:22:41.297128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1034/2131] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:42.236448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:42.236835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:42.243300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.243788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.244232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.245076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.245409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.245867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.278456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:42.280655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:42.287580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:42.290224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.291049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.291716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.292661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.293334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.294127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.344460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd18a8ec-1ec7-4a0c-83e0-8cd1ec3ecda6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073248 Aug 08 17:22:42.346604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1035/2132] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:42.355084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:42.355784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:42.367824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.368316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.368769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.369454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:42.369934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:42.370357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:42.374595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:42.375287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:42.385708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:42.387582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:42.392060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-32a88618-87e6-4e01-bb8c-7796d469c59a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.157423 Aug 08 17:22:42.392060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1098/2133] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:42.522278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:42.530238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c6fa0dc8-5929-4e5c-8cc1-04c174fc9d99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.182400 Aug 08 17:22:42.531644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1036/2134] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:42 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:43.357548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:43.359818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:43.366309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.366792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.367231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.367920 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.368375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.368801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.406855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b897cd12-dc4d-45cb-a3be-262771ad6acf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Aug 08 17:22:43.406855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1099/2135] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:43.412826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:43.413441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:43.420874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.421356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.421930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.422642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.423100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.423520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.487567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:43.496011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:43.497508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:43.498669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-711980e3-ee6e-49ab-998b-500ca987d793 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089709 Aug 08 17:22:43.499225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1037/2136] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:43.551662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:43.552217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:43.558284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.559761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.559761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.559959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:43.560336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:43.560759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:43.580089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:43.706013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:43.715992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aed4cbee-3304-4854-bd50-6bad82d84884 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.167122 Aug 08 17:22:43.715992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1100/2137] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:44.414290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:44.416424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:44.423639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.424350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.424954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.425862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.426312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.426972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.465490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9f567b51-08fe-4b0b-a96b-a169571e4537 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054974 Aug 08 17:22:44.466146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1038/2138] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:44.521998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:44.522709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:44.529609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.530193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.530702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.531682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.532382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.533219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.594821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:44.603328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:44.604822 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:44.605999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-54a1c12a-ae5d-482b-9206-3df77f1f8909 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088298 Aug 08 17:22:44.611712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1101/2139] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:44.736734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:44.737443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:44.743462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.743945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.744380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.745082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:44.745526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:44.745988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:44.892111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:44.900475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-387981e2-0bd8-4b2c-9d3d-14b68ec3a8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.168296 Aug 08 17:22:44.901028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1039/2140] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:45.477974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:45.480148 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:45.486081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.486570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.487014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:45.487704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.488160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.488585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:45.519643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4cb9f3ce-7547-42d5-80f9-612e6f14d469 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Aug 08 17:22:45.520216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1102/2141] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:45.629054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:45.631748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:45.636451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.636927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.637389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:45.638111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.638572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.639002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:45.699856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:45.709019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:45.710579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:45.711708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-01568f98-4673-4fb3-9f93-6fceaf608a85 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086575 Aug 08 17:22:45.712502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1040/2142] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:45.922199 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:45.922816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:45.928829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.929308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.929746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:45.930453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:45.931238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:45.931669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:46.066394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:46.074520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bb2b9df6-cde0-4661-840c-49f45378a787 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156682 Aug 08 17:22:46.075087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1103/2143] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:22:46.537090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:46.539340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:46.545988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:46.546494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:46.546938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:46.547649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:46.548105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:46.548531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:46.580104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f024af3d-e5e5-40ac-ba4b-3a68b26f0a20 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Aug 08 17:22:46.580689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1041/2144] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:46.733526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:46.734165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:46.740144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:46.740624 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:46.741060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:46.741744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:46.742227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:46.742655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:46.802520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:46.810653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:46.812201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:46.813337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2f7a1877-2eb0-4726-bb26-16947fcc8154 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083765 Aug 08 17:22:46.813918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1104/2145] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:47.095443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:47.096037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:47.102033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.102516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.102951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.103630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.104084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.104510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.234242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:47.237871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e80e885-0125-4b57-acef-6b92a279e0d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146314 Aug 08 17:22:47.238433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1042/2146] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:47 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:47.592697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:47.594882 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:47.601467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.601991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.602435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.603121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.603579 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.604004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.633384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8fc64d5e-4577-4cf0-88a2-114b93568f29 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 08 17:22:47.633956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1105/2147] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:47.835995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:47.836607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:47.843037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.844039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.844475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.845152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:47.845629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:47.846078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:47.908639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:47.917011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:47.918542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:47.919673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5198daff-ffcc-4f89-8daa-f63aef0aa7e1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087611 Aug 08 17:22:47.920224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1043/2148] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:48.259666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:48.260284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:48.266470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.266957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.267390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:48.268072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.268520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.268942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:48.395746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:48.403600 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-09c6e142-532a-44a6-a016-5fcdf4e3d029 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148045 Aug 08 17:22:48.404377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1106/2149] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:48 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:48.644944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:48.647111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:48.653151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.653635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.654109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:48.654792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.655245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.655672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:48.684582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8f6f1e54-61e5-49e0-91a2-35b31bc1c4b6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Aug 08 17:22:48.685122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1044/2150] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:48.941958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:48.942501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:48.948870 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.949350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.949847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:48.950526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:48.950977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:48.951400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:49.011958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:49.020678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:49.022181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:49.023311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-20d007c9-da26-4353-9297-62d0e6ab1f3e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085407 Aug 08 17:22:49.023858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1107/2151] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:49.424431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:49.425041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:49.431514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:49.432019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:49.432452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:49.433124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:49.433569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:49.434012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:49.564186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:49.572060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c83f5b59-0c2e-4798-b72d-a33ba0cd7dec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151528 Aug 08 17:22:49.572611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1045/2152] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:49 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:49.695988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:49.698090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:49.704082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:49.704560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:49.705002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:49.705692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:49.706177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:49.706607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:49.734818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-65e6a857-77d1-4a00-8b43-43656ba4c614 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Aug 08 17:22:49.735359 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1108/2153] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:50.045797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:50.046456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:50.052827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.053301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.053732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.054430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.054878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.055295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.114381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:50.123016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:50.124517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:50.125647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09010dbb-ee94-456a-8d7a-44c49eae962a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083796 Aug 08 17:22:50.126296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1046/2154] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:50.592962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:50.596569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:50.600089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.600573 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.601010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.601705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.602192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.602714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.731273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:50.739867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7ec92ab3-8894-42d3-90e4-cab75db7c41a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151268 Aug 08 17:22:50.740506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1109/2155] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:50.746764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:50.748892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:50.755072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.757101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.757101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.757101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:50.757101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:50.757766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:50.786399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e3ec5fa-ad56-4428-a01b-57e89007c61b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Aug 08 17:22:50.789836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1047/2156] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:51.147408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:51.148026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:51.153941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.154419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.154854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.155537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.155989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.156413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.215836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:51.224038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:51.225584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:51.226733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-79fee780-02ba-43f6-b56f-be644d6e21b3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083283 Aug 08 17:22:51.227287 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1110/2157] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:51.761191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:51.761829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:51.768745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.769231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.769671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.770385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.770842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.771277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.798997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:51.801229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:51.808143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.810739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.810739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.810739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:51.810739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:51.811106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:51.841286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5fe37f2d-4efc-4f9d-8a4e-d904617cdf1a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Aug 08 17:22:51.842099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1111/2158] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:22:51.903032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:51.911345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f7023d0-6957-49da-bb21-fe58c7be0d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154356 Aug 08 17:22:51.911907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1048/2159] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:22:52.249193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:52.250376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:52.256081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.256520 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.256962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:52.257940 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.258406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.258833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:52.322264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:52.331216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:52.332728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:52.333902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1fbc19be-d143-4822-817f-13744295841e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088566 Aug 08 17:22:52.334461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1112/2160] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:52.852968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:52.855084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:52.862002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.862492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.862934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:52.863624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.864086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.864513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:52.893425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3121e174-4d31-4415-ab75-368a77a7034f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Aug 08 17:22:52.893972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1049/2161] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:52.932229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:52.932843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:52.939130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.939603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.940031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:52.940704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:52.941155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:52.941576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:53.072067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:53.079952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4e0765bf-70dc-4405-bd09-e6bc9fb0d4ec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151454 Aug 08 17:22:53.080505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1113/2162] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:53.355759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:53.356368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:53.362770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:53.363248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:53.363706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:53.364380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:53.364827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:53.365247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:53.425197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:53.433613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:53.435159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:53.436304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d7fe9797-33d5-46d9-8d96-38c8906c15fc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084433 Aug 08 17:22:53.436859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1050/2163] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:53.904771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:53.907461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:53.913350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:53.913866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:53.914303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:53.914983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:53.915431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:53.915853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:53.944622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5d3a1609-877b-47e2-ab62-ce9e7e8f5be5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 08 17:22:53.945223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1114/2164] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:54.100571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:54.101113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:54.107547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.108028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.108465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.109150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.109610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.110061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.235674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:54.245975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c388dc5-ccbe-4bbd-b0dc-6fd9468dc16f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146931 Aug 08 17:22:54.245975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1051/2165] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:54 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:54.459702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:54.460249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:54.466224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.466710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.467156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.467844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.468303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.468732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.529589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:54.537901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:54.539388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:54.540513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b4aae889-fd4c-4b35-b83d-922efa42bdbb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084805 Aug 08 17:22:54.541077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1115/2166] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:54.957321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:54.959553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:54.965761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.966271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.966705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.967390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:54.967839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:54.968262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:54.992452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:54.996737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7cae99c4-f0ae-4f1d-8b30-b32ccefdf198 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Aug 08 17:22:54.997275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1052/2167] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:55.264788 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:55.265445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:55.271876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:55.273446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:55.273446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:55.273446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:55.273941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:55.274377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:55.405223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:55.413752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-72d41449-0a8f-4645-b348-f5fe3dc5cdb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152815 Aug 08 17:22:55.414348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1116/2168] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:55 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:55.563056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:55.563588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:55.569915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:55.570387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:55.570813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:55.571485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:55.571960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:55.572377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:55.636337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:55.645123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:55.646898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:55.648024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00a447d0-f897-4fde-ad17-0adf3decca92 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089322 Aug 08 17:22:55.648567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1053/2169] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:56.008815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:56.011049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:56.017491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.018011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.018450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.019129 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.019581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.020002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.023580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:22:56.047958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4f04bed1-bb4b-4e86-aaa3-f4d7a8e3f967 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043355 Aug 08 17:22:56.048550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1117/2170] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:56.435617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:56.436234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:56.442802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.443286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.443727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.444474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.444939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.445366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.575311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:56.583233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-78902082-1f17-4e67-84df-5cf77f6a85af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151489 Aug 08 17:22:56.583790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1054/2171] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:56 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:56.672081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:56.673321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:56.680127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.680608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.681038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.681715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:56.682193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:56.682617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:56.742288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:56.753668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:56.757956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:56.759107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-248d8957-8c4c-476f-8244-de18a8a0015d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090892 Aug 08 17:22:56.762018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1118/2172] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:57.060162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:57.062336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:57.068229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.068711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.069144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.069844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.070294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.070716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.103667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb072489-481e-4686-8406-24ce57254539 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Aug 08 17:22:57.104204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1055/2173] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:57.604381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:57.604997 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:57.610934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.611413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.611846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.612524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.612970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.613387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.737081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:57.744811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e983f5e5-7bef-426b-932e-a817d9e4fc60 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.144272 Aug 08 17:22:57.745363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1119/2174] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:57.783406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:57.784221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:57.790411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.790897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.791332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.792019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:57.792474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:57.792899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:57.852644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:57.861383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:57.862939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:57.864115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-85f22474-d6d2-48ee-bfe9-9047f1a4ca70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084621 Aug 08 17:22:57.864662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1056/2175] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:22:58.116379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:58.118490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:58.124425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.124912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.125354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.126068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.126532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.126962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.155329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-64cbc806-9b4c-43c2-81c7-04b001b9cfae tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Aug 08 17:22:58.155893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1120/2176] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:58.766904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:58.767552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:58.773614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.774131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.790370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.790370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.790370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.790370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.887917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:58.888541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:58.894996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.895508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.895974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.896662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:58.897123 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:58.897537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:58.904111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:58.912492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2d929968-bee5-49cc-a767-733a9adead29 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149419 Aug 08 17:22:58.913042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1057/2177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:22:58.962695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:58.971467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:58.972947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:22:58.974101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4939967f-5064-4973-890d-44cc9a6c0560 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090120 Aug 08 17:22:58.974647 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1121/2178] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:22:59.168152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:59.170322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:59.176891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:59.177379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:59.177837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:59.178528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:59.178981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:59.179404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:59.207693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-260589d0-7233-4d5a-98fb-b66199c0565c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Aug 08 17:22:59.208234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1058/2179] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:22:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:22:59.934235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:59.934875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:22:59.941217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:59.941692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:59.942157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:59.942833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:22:59.943283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:22:59.943704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:22:59.996467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:22:59.997134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:00.003583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:00.004066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:00.004534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:00.005259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:00.005717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:00.006170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:00.067089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:00.071351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:00.075519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:00.077015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:00.078176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-69ed1a3f-8f36-4254-8c82-4a31122a81c3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085615 Aug 08 17:23:00.078736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1059/2180] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:22:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:00.079893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-352fa715-32d0-4a63-84ab-201967e04813 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149206 Aug 08 17:23:00.080435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1122/2181] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:22:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:00.219360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:00.222210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:00.228194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:00.228683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:00.229129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:00.229840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:00.230302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:00.230730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:00.260023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b85ee1d-70b1-4f98-ba8f-6d15f89272da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Aug 08 17:23:00.260575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1060/2182] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:01.100738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:01.101376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:01.107842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.108319 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.108750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.109434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.109910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.110332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.110482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:01.111115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:01.117543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.118081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.118526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.119220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.119676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.120105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.173478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:01.182094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:01.183597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:01.184733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e7b4700f-7c0e-4e28-9081-cae9059f7cb4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087853 Aug 08 17:23:01.185288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1123/2183] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:01.251961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:01.260065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9494cdc-1196-4881-b983-f7fa1d18015b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153406 Aug 08 17:23:01.260622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1061/2184] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:01.271994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:01.274247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:01.280321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.280815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.281260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.282052 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:01.282534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:01.285587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:01.311454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-66b4bd99-ca9b-4a99-98ac-81a16bcdd79a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 08 17:23:01.312009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1124/2185] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:02.206996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:02.207630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:02.214316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.214792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.215228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.215904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.216349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.216767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.282162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:02.282792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:02.283057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:02.285846 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:02.290613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.291100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.291536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.292229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.292590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:02.292747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.293099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.294115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:02.295315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68615e59-a8b2-417b-b2f0-195a2b20c404 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.092676 Aug 08 17:23:02.296055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1062/2186] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:02.323933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:02.326171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:02.332664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.333950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.333950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.334322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:02.334768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:02.335192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:02.364795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6cfbac9f-4aef-4806-b9ee-3f90e0e09c96 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 Aug 08 17:23:02.365362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1063/2187] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:23:02.424652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:02.432627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6089aa4f-a115-4fc1-b918-8f4295ead14a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154607 Aug 08 17:23:02.433186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1125/2188] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:02 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:03.317937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:03.318632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:03.324975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.325447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.325906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.326585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.327033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.327454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.376707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:03.378957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:03.386012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.386471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.386913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.387620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.388077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.388527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.419949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-76ddd372-f092-4c96-894c-2f1e88ac47b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047167 Aug 08 17:23:03.420535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1126/2189] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:23:03.454434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:03.455232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:03.461581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.462105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.462599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.463259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:03.463723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:03.464152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:03.599844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:03.608159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a417ac06-7117-4c87-a9ec-bf4f638e5065 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.157779 Aug 08 17:23:03.620320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1127/2190] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:03 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:03.622735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:03.631195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:03.632967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:03.634133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cd093708-0625-4f80-86a3-72afbab6aa75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.320147 Aug 08 17:23:03.634688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1064/2191] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:04.432550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:04.434753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:04.441069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.441549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.442025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.442706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.443158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.443584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.473080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9a5e07d4-42ca-4517-997b-eb453d793db6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Aug 08 17:23:04.473622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1128/2192] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:04.630603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:04.631222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:04.637871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.638357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.638799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.639481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.639937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.640357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.656825 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:04.657449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:04.664219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.664696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.665130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.665832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:04.666289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:04.666705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:04.727871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:04.736325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:04.737859 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:04.739005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1b772fe1-efab-47b3-a09b-17e0c8546f5c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086663 Aug 08 17:23:04.739786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1129/2193] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:04.770658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:04.778855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-284cc371-0194-4976-a0c6-c6e158b2e001 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152072 Aug 08 17:23:04.779408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1065/2194] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:05.485206 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:05.487397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:05.494288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.494774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.495212 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.495895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.496436 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.496866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.526634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0cb01192-e2ba-4e1d-a01a-6623f55b67ed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Aug 08 17:23:05.527185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1130/2195] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:05.760935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:05.761534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:05.768278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.768752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.769436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.770145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.770643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.771066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.800130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:05.800741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:05.807343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.807826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.808259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.808990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:05.809396 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:05.809838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:05.834539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:05.842862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:05.844298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:05.845443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-512344a5-4df8-4de8-9ca3-fe832c5ad356 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088626 Aug 08 17:23:05.846047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1066/2196] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:05.940027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:05.947950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8ac3ef63-9b90-4290-87be-5cd6e17355ae tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151699 Aug 08 17:23:05.948507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1131/2197] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:06.539026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:06.541094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:06.547084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.547569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.548006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:06.548698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.549150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.549603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:06.577861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3c916f3-9e7c-4571-9454-acc9f7032eff tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042947 Aug 08 17:23:06.578404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1067/2198] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:06.868751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:06.869293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:06.875850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.876332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.876768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:06.877449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.877933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.878357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:06.938984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:06.947916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:06.949407 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:06.950562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9a68cb09-8a1c-4d13-8932-ca5091cbe625 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085867 Aug 08 17:23:06.951119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1132/2199] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:06.968899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:06.969514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:06.975933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.976413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.976847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:06.977530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:06.978009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:06.978439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:07.107460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:07.115895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3fc23123-ce0c-4c69-9879-947392becb6f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150826 Aug 08 17:23:07.116451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1068/2200] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:07.590746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:07.593061 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:07.599792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:07.600279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:07.600721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:07.601416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:07.601900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:07.602329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:07.625840 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:07.630121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-48586a28-fd6e-4e5e-9ff1-fef0049eef8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Aug 08 17:23:07.630667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1133/2201] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:07.973505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:07.974140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:07.980797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:07.981270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:07.981702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:07.982473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:07.982924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:07.983342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:08.001966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:08.047447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:08.056640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:08.058201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:08.059312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-305f9e63-1e20-4ecc-a3bf-31e5b15c52ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090131 Aug 08 17:23:08.059854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1069/2202] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:08.136649 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:08.137270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:08.144161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:08.144643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:08.145083 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:08.145771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:08.146253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:08.146685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:08.272828 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:08.280723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e6c69bcf-b360-4989-bffa-9198ed91fa95 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147878 Aug 08 17:23:08.282827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1134/2203] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:08.642499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:08.645301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:08.651178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:08.651660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:08.652095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:08.652774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:08.653230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:08.653653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:08.681102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8357edaa-6da5-4452-a880-afd5c9153126 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Aug 08 17:23:08.681627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1070/2204] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:09.081925 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:09.082538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:09.088415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.088894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.089334 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.090041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.090493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.090918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.154545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:09.162963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:09.164463 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:09.165598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-43d90beb-bec8-4b22-b40b-754bc29355f2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087600 Aug 08 17:23:09.166188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1135/2205] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:09.302202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:09.302808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:09.309286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.309761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.310217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.310891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.311339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.311758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.442006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:09.449754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e0187cb-46b2-4e74-9bce-011389ab9b59 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152159 Aug 08 17:23:09.450332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1071/2206] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:09 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:09.693205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:09.695354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:09.701303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.701806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.702249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.702931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:09.703388 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:09.703816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:09.732817 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-78361c1e-b9a9-4d4c-8263-7c97791fbbc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Aug 08 17:23:09.733357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1136/2207] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:10.188453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:10.189058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:10.195542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.196020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.196452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.197128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.197571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.198013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.258097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:10.266448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:10.267933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:10.269056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe4ffadd-b6f4-4cc4-8ca7-a4e011dbf628 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084494 Aug 08 17:23:10.270256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1072/2208] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:10.470570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:10.471185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:10.477490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.478071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.478509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.479472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.479927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.480354 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.608119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:10.616617 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ee6f9610-ac61-424e-a63f-2d8c728fa653 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149866 Aug 08 17:23:10.617189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1137/2209] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:10 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:10.745367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:10.747482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:10.754494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.754976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.755413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.756094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:10.756547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:10.757233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:10.786065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ef3ce27-7c35-40ed-8402-d43d9635ec24 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Aug 08 17:23:10.786625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1073/2210] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:11.292191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:11.292801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:11.298746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.299220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.299653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.300375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.300830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.301255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.361590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:11.369857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:11.371356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:11.372478 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-13805fdf-deb5-48ef-a636-9fd766362be4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084237 Aug 08 17:23:11.373030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1138/2211] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:11.638365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:11.638974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:11.645534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.646039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.646473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.647155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.647609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.648030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.774902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:11.782935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d7e89d3e-9081-4c9e-bc94-34167f76f160 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148499 Aug 08 17:23:11.783485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1074/2212] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:11.798262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:11.800481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:11.806847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.807331 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.807765 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.808446 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:11.808897 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:11.809367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:11.842077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c52e8231-d499-439e-a457-464bf61602f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 Aug 08 17:23:11.843307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1139/2213] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:12.394703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:12.395242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:12.397097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=80 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:12.401705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.402212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.402641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.403342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.403792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.404210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.464450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:12.473289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:12.474843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:12.475984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7150e3eb-5bf3-4c2c-95dc-19edd9198e12 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085274 Aug 08 17:23:12.476543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1075/2214] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:12.804035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:12.804646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:12.811166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.811638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.812069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.812752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.813202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.813622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.855321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:12.857609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:12.863605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.864093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.864534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.865231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:12.865691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:12.866150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:12.897255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75388082-be0d-4b78-aa32-789734bf40f4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Aug 08 17:23:12.898049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1076/2215] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:23:13.180102 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:13.187928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5fb78203-6254-49ad-96ed-1be20e7e84e0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.387783 Aug 08 17:23:13.188497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1140/2216] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:13.500796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:13.501410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:13.508305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:13.508787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:13.509223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:13.509932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:13.510386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:13.510812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:13.574570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:13.583010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:13.585068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:13.585992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb287014-e7ad-4118-bb3a-c316938d107b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089168 Aug 08 17:23:13.586542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1077/2217] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:13.908795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:13.911402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:13.917806 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:13.918302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:13.918747 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:13.919440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:13.919905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:13.920336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:13.948879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ae686205-31e6-4b88-9da9-458ba8bdea37 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 08 17:23:13.949422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1141/2218] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:14.208987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:14.209523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:14.215982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.216468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.216903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:14.217584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.218079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.218504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:14.346762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:14.355181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b73df7b-3137-46c9-951a-9644a435a796 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150638 Aug 08 17:23:14.355741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1078/2219] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:14.608213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:14.608823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:14.614801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.615343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.615778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:14.616456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.616906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.617328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:14.678160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:14.686483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:14.687969 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:14.689087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c48f3cb0-ccdc-496e-a4c6-db49053b9c47 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084751 Aug 08 17:23:14.689639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1142/2220] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:14.960285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:14.962496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:14.968511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.968997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.969440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:14.970159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:14.970620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:14.971050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:15.000461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19f1850e-9203-4d1e-b01b-02883efe6943 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Aug 08 17:23:15.001006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1079/2221] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:15.375896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:15.376505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:15.383159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:15.383634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:15.384064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:15.384745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:15.385194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:15.385612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:15.516149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:15.524142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0b9ff4c4-9d10-4ccf-b3cf-a9b1855e20e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152061 Aug 08 17:23:15.524705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1143/2222] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:15.712721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:15.713262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:15.719615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:15.720099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:15.720532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:15.721216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:15.721671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:15.722128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:15.782287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:15.791280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:15.792777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:15.793939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d61b171f-6996-4c49-964d-78cb3acc29c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085270 Aug 08 17:23:15.794492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1080/2223] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:16.012826 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:16.015146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:16.021879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.022368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.022815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.023506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.023967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.024399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.052149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56686cfc-1b99-4d48-8d8d-6eec9fb8fbde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Aug 08 17:23:16.052688 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1144/2224] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:16.544523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:16.545149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:16.551740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.552220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.552650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.553329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.553813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.554239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.683593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:16.691908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ea517919-c50e-4fd1-85f8-38ef2d17ae40 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150744 Aug 08 17:23:16.694741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1081/2225] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:16 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:16.815966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:16.816481 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:16.822417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.822904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.823345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.824028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:16.824515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:16.824942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:16.884194 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:16.892369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:16.893906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:16.895070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9732f52e-a05b-456e-8250-17822189b5eb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083163 Aug 08 17:23:16.895623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1145/2226] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:17.064244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:17.066517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:17.072411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.072900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.073341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.074059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.074551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.074977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.103809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f657f4e4-2a47-4a65-87a0-c52de1d0c172 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Aug 08 17:23:17.104348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1082/2227] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:17.713408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:17.714041 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:17.720392 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.720867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.721300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.722004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.722960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.723380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.846750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:17.855024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9d25e5da-be89-4409-8c7e-5206d23f9bec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145422 Aug 08 17:23:17.855583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1146/2228] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:17 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:17.917424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:17.918063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:17.924367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.924844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.925310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.926022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:17.926473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:17.926893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:17.986992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:17.995283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:17.996769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:17.997933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ec6f041-d385-45f0-b626-bb3c1de59fd8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084313 Aug 08 17:23:17.998479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1083/2229] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:18.115752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:18.117914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:18.123722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:18.124202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:18.124639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:18.125317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:18.125768 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:18.126291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:18.154357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-90443332-2561-4b4d-94cc-2de293d6290c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Aug 08 17:23:18.154892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1147/2230] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:18.876247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:18.876872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:18.883706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:18.884184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:18.884614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:18.885290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:18.885742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:18.886184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:19.012431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:19.020450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9837ddb-3343-4df3-b05e-88419efc50bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148134 Aug 08 17:23:19.020642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:19.021066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1084/2231] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:19.021291 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:19.027767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:19.028321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:19.028833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:19.029592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:19.030165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:19.030676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:19.091541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:19.100406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:19.101915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:19.104614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-655c4b85-19ee-4d14-8222-e625a01b74f3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086494 Aug 08 17:23:19.104614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1148/2232] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:19.166855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:19.168936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:19.174869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:19.175449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:19.176333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:19.177011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:19.178023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:19.178023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:19.205998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c3883c90-aa08-4146-90c3-452d9c4d1bed tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Aug 08 17:23:19.206543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1085/2233] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:20.041210 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:20.041851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:20.048217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.048699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.049135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.049836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.050292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.050720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.125060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:20.125708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:20.133065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.133576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.134052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.134746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.135210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.135639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.139666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:20.179909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:20.187894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-67ce316b-48f0-438e-bc6b-c961e627bd10 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150458 Aug 08 17:23:20.188831 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1149/2234] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:20.201974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:20.210404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:20.211976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:20.213113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d93ca296-7356-45db-ae1e-a7a8fde4413c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091996 Aug 08 17:23:20.213653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1086/2235] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:20.217982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:20.220151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:20.226196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.226677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.227108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.227785 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:20.228234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:20.228654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:20.245079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:20.258112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-65e71a54-6309-4666-84bd-4f7382cd4a43 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044001 Aug 08 17:23:20.258951 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1150/2236] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:23:21.209238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:21.209897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:21.216372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.216858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.217300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.218028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.218488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.218917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.234484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:21.235169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:21.242097 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.242601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.243024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.243713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.244169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.244599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.308009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:21.317013 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:21.318544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:21.319692 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-94dbfec3-0735-4100-893a-16ccabfca6bf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089151 Aug 08 17:23:21.320242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1151/2237] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:21.324684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:21.326838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:21.333158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.333654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.334116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.334811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:21.335269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:21.335693 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:21.353691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:21.361672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b2c08d4-f9ac-4c1a-9018-5b93dd07aa0d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156775 Aug 08 17:23:21.362355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1087/2238] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:21 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:21.363864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-054b25f9-5619-4f49-82df-e23002de6e89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Aug 08 17:23:21.364413 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1152/2239] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:22.341820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:22.342377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:22.348721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.349685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.350140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.350814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.351262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.351682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.375944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:22.378179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:22.384935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.385424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.385983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.386683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.387141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.387567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.413480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:22.417008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7f21b95e-1517-497d-8a72-bbceebed8592 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 08 17:23:22.417574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1153/2240] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:23:22.421908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:22.422078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:22.422531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:22.423399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:22.424527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-000997a8-0a78-4bb3-9594-2c300186a058 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086703 Aug 08 17:23:22.425063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1088/2241] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:22.428900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.429378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.429830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.430519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:22.430966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:22.431384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:22.563542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:22.571431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f335f2a8-cf22-4968-b6a6-05c845010f90 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152904 Aug 08 17:23:22.571995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1154/2242] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:22 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:23.429060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:23.431232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:23.437606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.438139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.438557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.439244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.439728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.440155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.449590 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:23.450380 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:23.457056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.457537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.458019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.459286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.459738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.460156 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.478637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b243d8aa-6aca-4a9b-838e-ade5fbf1149f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053484 Aug 08 17:23:23.479201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1089/2243] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:23.522096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:23.530340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:23.531823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:23.532964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a7d602de-fd25-48da-8bac-5f3ff0038f17 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088530 Aug 08 17:23:23.533498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1155/2244] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:23.591425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:23.592098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:23.598071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.598553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.598993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.599677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:23.600127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:23.600549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:23.731425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:23.739343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28a01121-629d-4ebe-9786-0570b14bbfec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151814 Aug 08 17:23:23.744026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1090/2245] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:23 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:24.490453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:24.492604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:24.499267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.499754 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.500195 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.500901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.501385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.501852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.530363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-07c5903d-73a9-4a5d-bbee-b852f83e463d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 08 17:23:24.530844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1156/2246] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:24.554734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:24.555348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:24.561756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.562264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.562702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.563384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.563836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.564288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.624773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:24.634040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:24.635542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:24.636671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8cc6a442-3abc-4f7a-83ac-ddb00eebbe6f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085776 Aug 08 17:23:24.637222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1091/2247] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:24.762793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:24.763403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:24.769297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.769774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.770238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.771519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:24.771970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:24.772390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:24.899196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:24.907106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3b40f239-5ea7-43a4-acb6-b1f91794447d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148154 Aug 08 17:23:24.907669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1157/2248] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:24 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:25.543168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:25.545320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:25.551291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.551777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.552838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:25.553530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.554012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.554440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:25.582457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7baf389-3593-4d88-8479-81baeb812f8d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 08 17:23:25.583103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1092/2249] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:25.659304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:25.659915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:25.666942 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.667456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.667895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:25.668580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.669036 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.669462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:25.737261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:25.746415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:25.747916 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:25.749058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d2709323-7bf9-428b-8c9e-b5b433f25e87 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.093616 Aug 08 17:23:25.749616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1158/2250] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:25.928073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:25.928609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:25.934623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.935041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.935479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:25.936161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:25.936619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:25.937041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:26.062004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:26.069777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9faeff6-f208-4a69-8023-f3c034f0efd8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145741 Aug 08 17:23:26.070356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1093/2251] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:26.594887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:26.597040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:26.603023 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:26.603505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:26.603947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:26.604637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:26.605095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:26.605523 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:26.634544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9c6404f-c1fe-40a1-a621-c3eb07083c2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Aug 08 17:23:26.635104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1159/2252] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:26.771220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:26.771881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:26.778906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:26.778906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:26.779167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:26.779851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:26.780305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:26.780728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:26.844075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:26.853119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:26.854753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:26.855890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76ec26ad-941a-4e96-8c8f-36ef4edd21de tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089011 Aug 08 17:23:26.856438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1094/2253] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:27.090412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:27.091030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:27.097501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.097967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.098410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.099593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.100098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.100529 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.229660 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:27.237714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-15a6bab8-c561-4e41-a0ad-d0f61c2bbd9d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151114 Aug 08 17:23:27.242295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1160/2254] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:27.647361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:27.649422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:27.655359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.655838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.656269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.656949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.657397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.657838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.684958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d86c4726-e46a-4e33-8f27-d7eb1aa9c73f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Aug 08 17:23:27.685495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1095/2255] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:27.878835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:27.879445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:27.886503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.886982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.887417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.888095 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:27.888543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:27.888963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:27.947896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:27.956028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:27.957515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:27.959490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aa5f097b-5f85-4f85-8804-55291644f4ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084543 Aug 08 17:23:27.960039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1161/2256] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:28.261580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:28.262234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:28.268677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.274064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.274064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:28.274064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.274064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.274505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:28.397301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:28.405083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f828423d-83e6-4990-a79b-948767f040e5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147271 Aug 08 17:23:28.405636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1096/2257] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:28 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:28.697137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:28.699320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:28.705939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.706418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.706854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:28.707531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.707978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.708399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:28.736651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fdb25d41-be8c-45f5-9cbd-9a66c2c00b36 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Aug 08 17:23:28.737180 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1162/2258] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:28.980800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:28.981410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:28.987334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.987810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.988243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:28.988918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:28.989419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:28.989869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:29.050569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:29.058847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:29.060356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:29.061499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-981403a5-7cca-4ea5-b16f-2ff0b0498966 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084573 Aug 08 17:23:29.062103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1097/2259] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:29.426655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:29.427270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:29.433181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:29.433656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:29.434125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:29.434800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:29.435249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:29.435669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:29.563924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:29.572489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f8828755-f08a-41bb-af87-1f29aca34ebf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149709 Aug 08 17:23:29.573070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1163/2260] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:29 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:29.748470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:29.750667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:29.757865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:29.758348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:29.758785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:29.759464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:29.759917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:29.760338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:29.788716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7333cdd8-9b61-4790-9c78-80458ecf67c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Aug 08 17:23:29.789265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1098/2261] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:30.083684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:30.084302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:30.090780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.091267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.091708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.092394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.092863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.093279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.154134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:30.163005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:30.164507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:30.165640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1677145c-9159-4d6b-880e-f3b9fe0fc68e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085886 Aug 08 17:23:30.166232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1164/2262] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:30.592654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:30.593288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:30.599830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.600320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.600764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.601460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.601947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.602376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.730967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:30.738822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1acba92d-9905-4d4a-93fa-671998194bba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150063 Aug 08 17:23:30.739378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1099/2263] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:30 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:30.800876 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:30.803045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:30.808881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.811959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.811959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.811959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:30.811959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:30.812342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:30.840091 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-22e58bda-4b79-4c6b-98c0-23e5b60cbe89 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Aug 08 17:23:30.840703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1165/2264] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:31.188361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:31.188889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:31.195965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.196931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.196931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.197517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.198004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.198422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.259288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:31.267622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:31.269140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:31.270321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac430a51-cb63-4c14-b7bc-9f01006372bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085952 Aug 08 17:23:31.270868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1100/2265] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:31.759979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:31.760629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:31.767108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.767597 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.768039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.768728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.769191 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.769621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.853062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:31.855330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:31.861337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.861852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.862295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.862979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:31.863433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:31.863856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:31.892667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d1ad32bc-4e50-4b3f-8ab5-84b7d4bdcf83 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Aug 08 17:23:31.893270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1101/2266] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:31.899891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:31.908008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7bb818eb-53d2-4b96-b5b4-2d132ce25299 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152169 Aug 08 17:23:31.908555 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1166/2267] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:31 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:32.292529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:32.293146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:32.299571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.300056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.300491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.301173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.301679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.302078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.362057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:32.365347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:32.370552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:32.372050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:32.373238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9beef16b-eb27-40da-8477-62ca9f883dfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084565 Aug 08 17:23:32.373741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1102/2268] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:32.904628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:32.906764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:32.909098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=84 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:32.914338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.914824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.915266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.915955 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.916410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.916835 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.920472 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:32.930201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:32.930806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:32.937098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.937573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.938051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.938729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:32.939176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:32.939633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:32.946533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-80d40bcc-44d5-41b4-bb70-d889161fd18f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 08 17:23:32.952626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1167/2269] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:33.072773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:33.080620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-24511f91-f815-429d-831a-1a9279f70832 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154844 Aug 08 17:23:33.081172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1103/2270] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:33.395996 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:33.396612 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:33.402636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:33.403121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:33.403559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:33.404239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:33.404698 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:33.405146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:33.467248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:33.472814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:33.474399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:33.475540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d7240dc0-cda8-414f-ae99-447b724c41a4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083831 Aug 08 17:23:33.476099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1168/2271] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:33.958731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:33.960872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:33.967209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:33.967682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:33.968111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:33.968786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:33.969232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:33.969654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:33.998580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0fb5a19-b8f0-4b4a-a8af-aa88388c9ea0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 08 17:23:33.999116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1104/2272] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:34.101976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:34.102581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:34.109008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:34.109492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:34.109962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:34.110652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:34.111108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:34.111533 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:34.240594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:34.248539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ee7d1012-168b-429d-af27-1bce3322bde3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151293 Aug 08 17:23:34.251118 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1169/2273] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:34.498163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:34.498770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:34.505457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:34.506228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:34.506664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:34.507353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:34.507800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:34.508215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:34.569756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:34.578361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:34.579933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:34.581138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe34009c-08cb-4a0c-8fd6-0380befd31ee tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086850 Aug 08 17:23:34.581764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1105/2274] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:35.011454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:35.013629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:35.019652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.020140 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.020581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.021269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.021730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.022283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.049813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3f72581-9c8c-4e3c-851b-9146d9c4796b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Aug 08 17:23:35.050361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1170/2275] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:35.270854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:35.271378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:35.277853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.280508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.280508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.280508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.280508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.280927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.407459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:35.415831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f1551cfd-d474-4e2c-a7d9-a281e5b0a352 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148932 Aug 08 17:23:35.416378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1106/2276] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:35 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:35.605108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:35.605721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:35.612030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.612504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.612938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.613628 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:35.614131 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:35.614554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:35.675015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:35.683246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:35.684761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:35.685914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3f0f048-629c-4c47-8597-2e5842bdc825 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084778 Aug 08 17:23:35.686462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1171/2277] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:36.062240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:36.064378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:36.070778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.071265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.071703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.072387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.072840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.073268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.101242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a28d3bcc-8282-4e6a-814f-ddd3bcaf7ac2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Aug 08 17:23:36.101779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1107/2278] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:36.437241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:36.437802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:36.444339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.444818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.445249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.445959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.446412 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.446834 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.574676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:36.582432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d5e4f517-da06-4f20-9182-e5404f1f156a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149070 Aug 08 17:23:36.583314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1172/2279] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:36 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:36.709632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:36.709632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:36.715117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.715599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.716032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.716721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:36.717161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:36.717584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:36.781907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:36.790929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:36.792637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:36.793808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d9efe82-c307-491f-8c46-43714a9c67c4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089676 Aug 08 17:23:36.794351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1108/2280] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:37.113204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:37.115411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:37.121718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.122231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.122668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.123344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.123793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.124213 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.152903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1cfe8f6e-5d0f-4f61-a45a-e337646965b2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Aug 08 17:23:37.153440 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1173/2281] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:23:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:23:37.603357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:37.604188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:37.610241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.610727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.611168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.611854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.612311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.612736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.736891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:37.745296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f0e6791-19bb-4efa-bb93-1b5684be5daa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145878 Aug 08 17:23:37.745870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1109/2282] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:37.816339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:37.817562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:37.823425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.823901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.824333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.825008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:37.825459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:37.825908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:37.885132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:37.893389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:37.894934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:37.896200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-11b70205-1ffd-496f-b616-23e190dd488b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083715 Aug 08 17:23:37.896746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1174/2283] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:38.165105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:23:38.167234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:38.173276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.173761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.174229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.174913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.175367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.175799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.296041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f83430be-f332-4216-9787-f331901b7e3d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action" status: 200 len: 76354 microversion: 2.1 time: 0.135190 Aug 08 17:23:38.297152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1110/2284] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:23:38 2022] POST /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e/action => generated 76354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:23:38.766923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:38.767569 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:38.774513 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.774992 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.775423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.776104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.776554 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.776974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.906076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:38.914172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ed9ff4e5-2700-49d8-814e-ca0baee9d911 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151003 Aug 08 17:23:38.914732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1175/2285] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:38.919044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:38.919752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:38.926649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.927135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.927578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.928269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:38.928725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:38.929151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:38.992488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:39.000819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:39.002367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:39.003504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4abffbd0-5d32-44b5-bf0e-1feb2087b426 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088710 Aug 08 17:23:39.004056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1111/2286] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:39.935173 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:39.935715 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:39.942085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:39.942568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:39.943004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:39.944181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:39.944635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:39.945060 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:40.025808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:40.026421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:40.032859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:40.033344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:40.033800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:40.034493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:40.034952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:40.035408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:40.073852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:40.081709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e63d274d-8785-4556-a61e-0b479aec0a3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150349 Aug 08 17:23:40.082316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1176/2287] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:40.096386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:40.104760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:40.106319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:40.107479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fed8da76-d79b-430b-a7f0-348f93545d06 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085439 Aug 08 17:23:40.108027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1112/2288] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:41.103142 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:41.103776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:41.110339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:41.110823 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:41.111262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:41.111966 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:41.112404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:41.112830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:41.131218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:41.131856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:41.138274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:41.138761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:41.139202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:41.139884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:41.140335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:41.140758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:41.206809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:41.215378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:41.216876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:41.218036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5b1dccf7-94fe-49f3-a717-07aca1337c07 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091501 Aug 08 17:23:41.218586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1113/2289] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:23:41.240850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:41.249277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ec474f8d-d89d-4609-90e7-d393c7c9194a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150491 Aug 08 17:23:41.249853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1177/2290] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:41.577894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:23:41.578108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:23:42.240422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:42.241058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:42.248268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:42.251696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:42.251696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:42.251696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:42.251696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:42.252063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:42.273778 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:42.274418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:42.280863 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:42.281418 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:42.281878 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:42.282626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:42.283088 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:42.283544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:42.312159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:42.320734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:42.322331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:42.324111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8bc2de40-91e2-4ee2-a33a-55f4993f8093 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087538 Aug 08 17:23:42.324714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1114/2291] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:42 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:42.411067 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:42.418944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-14ad118b-4ffe-47ea-aa38-a802f18a95c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149025 Aug 08 17:23:42.419508 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1178/2292] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:42 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:43.346887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:43.347503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:43.349958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=80 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:43.355123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:43.355604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:43.356040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:43.356725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:43.357198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:43.357652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:43.418234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:43.426421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:43.427942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:43.429076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-66378da7-7e97-4bad-b5c6-8d739dec1149 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086130 Aug 08 17:23:43.429621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1115/2293] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:43.440352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:43.440973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:43.447443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:43.447919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:43.448353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:43.449045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:43.449498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:43.449953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:43.582435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:43.591004 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3f39bb3b-6390-4d35-a0b3-9c449c120c54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154455 Aug 08 17:23:43.591574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1179/2294] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:44.400645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:23:44.401132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:23:44.457185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:44.457808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:44.464196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:44.464667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:44.465098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:44.465768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:44.466240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:44.466658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:44.527158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:44.535389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:44.536867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:44.538018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d595279e-6fb5-444f-b818-9bdbd84aa874 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084575 Aug 08 17:23:44.538561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1116/2295] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:44.611851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:44.612471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:44.618918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:44.619402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:44.620337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:44.621068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:44.621526 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:44.621983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:44.747700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:44.755757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-985fa1f4-c290-4495-b2a6-67257650115e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147593 Aug 08 17:23:44.756320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1180/2296] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:45.437493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:23:45.437726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:23:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:23:45.562794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:45.563407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:45.569875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:45.570354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:45.570787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:45.571463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:45.571913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:45.572333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:45.636962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:45.645333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:45.646891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:45.648021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7002275-754b-46f9-a40d-610d8520ffe5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091293 Aug 08 17:23:45.648564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1117/2297] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:45.777270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:45.777946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:45.784119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:45.784603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:45.785042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:45.785730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:45.786219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:45.786667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:45.917522 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:45.925355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-93091649-77e5-4ba0-9b64-540601ac3e6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152529 Aug 08 17:23:45.925943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1181/2298] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:46.670044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:46.670653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:46.676984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:46.677465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:46.677935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:46.678622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:46.679076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:46.679496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:46.739512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:46.754216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:46.755978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:46.757112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-394d8228-051b-4776-9b7b-a531cae67ca8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090995 Aug 08 17:23:46.757743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1118/2299] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:46.947010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:46.947560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:46.954483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:46.954964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:46.955399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:46.956082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:46.956539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:46.956963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:47.091042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:47.099015 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-58576eae-c240-441e-9100-dbbf29795639 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155935 Aug 08 17:23:47.099606 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1182/2300] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:46 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:47.780361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:47.780990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:47.787339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:47.787814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:47.788250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:47.788924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:47.789368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:47.789799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:47.849446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:47.852813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:47.858026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:47.859542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:47.860664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c40f9227-7e56-4bc9-919d-f856a7cde1b1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084747 Aug 08 17:23:47.861195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1119/2301] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:48.120381 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:48.120950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:48.127387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:48.127868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:48.128303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:48.128988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:48.129443 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:48.129890 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:48.259098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:48.263177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:23:48.268169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c15ddb56-b284-43b4-9a4a-906d53b9f30c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152021 Aug 08 17:23:48.268500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1183/2302] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:48 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:48.883566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:48.884175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:48.890615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:48.891092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:48.891519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:48.892204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:48.892639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:48.893058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:48.954920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:48.963072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:48.965079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:48.966369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eaa45f03-a4b3-45b6-a792-6d155ed8a5a9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087166 Aug 08 17:23:48.966923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1120/2303] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:49.289222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:49.289891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:49.296869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:49.297340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:49.297774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:49.298469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:49.298918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:49.299338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:49.425217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:49.433325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6a3c1ca5-940f-4b65-b5e8-2d0ad7495682 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148333 Aug 08 17:23:49.433917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1184/2304] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:49 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:23:49.988528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:49.989136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:49.996093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:49.996574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:49.997013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:49.997698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:49.998184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:49.998611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:50.061742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:50.070121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:50.071630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:50.072764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d1421868-8cc9-4d14-9995-6bb8228fea3d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088164 Aug 08 17:23:50.073311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1121/2305] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:50.454685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:50.455224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:50.461558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:50.462078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:50.462509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:50.463189 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:50.464138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:50.464557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:50.591329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:50.599372 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-29a9f3a6-12d5-4a21-ae77-2cd3a918ed86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148584 Aug 08 17:23:50.600181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1185/2306] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:51.095328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:51.095943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:51.102276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:51.102779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:51.103219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:51.103902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:51.104361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:51.104785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:51.164988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:51.173223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:51.174739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:51.175856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42e8c760-a1c4-44da-a356-79e346062e70 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084452 Aug 08 17:23:51.176394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1122/2307] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:51.620479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:51.621099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:51.627541 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:51.628027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:51.628468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:51.629151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:51.629609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:51.630321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:51.762259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:51.770042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c8423a18-9b4e-4984-8866-8e875f69d5aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153410 Aug 08 17:23:51.770607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1186/2308] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:52.199599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:52.200210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:52.206814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:52.207291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:52.207721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:52.208399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:52.208948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:52.209369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:52.270333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:52.278757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:52.284561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:52.284561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a8e2aa96-dd5a-4895-9afd-01f3cbaa2322 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086384 Aug 08 17:23:52.284561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1123/2309] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:52 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:52.792006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:52.792632 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:52.799101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:52.799614 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:52.800054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:52.800750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:52.801216 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:52.801648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:52.926841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:52.934899 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b013caac-e0da-4ab6-927d-f0e3ebff9b37 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147331 Aug 08 17:23:52.935468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1187/2310] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:53.304106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:53.304709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:53.311111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:53.311589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:53.312018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:53.312691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:53.313136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:53.313552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:53.373475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:53.381922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:53.383407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:53.384522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d51cb47-efcd-4304-9bb7-a3782fc98299 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084281 Aug 08 17:23:53.385725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1124/2311] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:53.956332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:53.956910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:53.963361 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:53.963851 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:53.964286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:53.965006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:53.965462 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:53.965915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:54.101532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:54.110116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c61f9551-9b5a-450c-b067-64cfa32d24e6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.157744 Aug 08 17:23:54.110681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1188/2312] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:53 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:54.407998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:54.408568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:54.419919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:54.420396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:54.420832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:54.425363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:54.425842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:54.426267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:54.495486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:54.504109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:54.505887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:54.507003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e36f2d76-a28b-4aa4-8e38-ec7b831abf24 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.102973 Aug 08 17:23:54.507546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1125/2313] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:55.131419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:55.132045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:55.139145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:55.139633 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:55.140075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:55.140767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:55.141229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:55.141659 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:55.268470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:55.276453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3a2814d3-af1b-4baa-9948-9f5d6be94656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149177 Aug 08 17:23:55.277022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1189/2314] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:55 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:55.531559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:55.532169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:55.538662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:55.539146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:55.539582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:55.540265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:55.540718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:55.541627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:55.604771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:55.613185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:55.614716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:55.615851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b774369-3e7b-47d6-967c-a7176fda295a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088251 Aug 08 17:23:55.616402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1126/2315] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:56.296592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:56.297253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:56.303800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:56.304320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:56.304792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:56.305570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:56.306066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:56.306506 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:56.432278 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:56.440099 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4e67e0ac-3c17-4460-949a-ead245fdf07a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147404 Aug 08 17:23:56.440666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1190/2316] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:56 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:56.638286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:56.638925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:56.645273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:56.645754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:56.646222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:56.646903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:56.647353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:56.647776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:56.707226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:56.715633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:56.717128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:56.718285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-55c26985-8950-44b4-9c5e-24d331f990c5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084531 Aug 08 17:23:56.718837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1127/2317] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:57.460544 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:57.461164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:57.468399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:57.468881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:57.469318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:57.470056 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:57.470507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:57.470930 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:57.601274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:57.609245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6340a5c2-a0c6-427e-9833-f557730f322e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152616 Aug 08 17:23:57.610042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1191/2318] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:57.740583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:57.741220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:57.747546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:57.748025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:57.748457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:57.749132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:57.749580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:57.750027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:57.816392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:57.825507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:57.827020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:57.828197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed668e48-029e-41e9-b788-2d8219306fc8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091408 Aug 08 17:23:57.828749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1128/2319] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:58.630605 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:58.631223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:58.637722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:58.638232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:58.638664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:58.639340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:58.639790 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:58.640214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:58.763667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:58.771742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b4fd1895-23e3-4c4a-8027-6eba72a54362 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.144979 Aug 08 17:23:58.772393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1192/2320] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:58.850772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:58.851294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:58.858948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:58.859465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:58.859902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:58.860618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:58.861071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:58.861498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:58.924442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:58.932708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:58.934233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:58.935356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6c7c97ce-6d44-4330-afc7-eb7a7fb83b01 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088571 Aug 08 17:23:58.935909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1129/2321] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:23:59.793309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:59.800026 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:59.800441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:59.800932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:59.801377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:59.802100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:59.802566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:59.802995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:59.933150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:23:59.941244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eead5c33-5171-4d3b-ad77-262811441405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152417 Aug 08 17:23:59.941830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1193/2322] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:23:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:23:59.957181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:23:59.957814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:23:59.964302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:59.964781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:59.965221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:23:59.965939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:23:59.966394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:23:59.966816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:00.027932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:00.036163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:00.037664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:00.038818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0030377b-201c-4603-97ba-1377da02e67f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085548 Aug 08 17:24:00.039365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1130/2323] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:23:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:00.962485 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:00.963027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:00.969471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:00.969994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:00.970433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:00.971113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:00.971576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:00.971981 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:01.061305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:01.062226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:01.068887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:01.069376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:01.069912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:01.070627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:01.071088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:01.071523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:01.100584 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:01.109444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3ea63f02-ceb8-47c0-8bdb-6369a8bb2f28 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150807 Aug 08 17:24:01.110274 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1194/2324] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:01.132971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:01.142087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:01.143570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:01.144692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-efa0889c-7661-4647-ada2-8c6874278ddf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087837 Aug 08 17:24:01.145233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1131/2325] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:02.130536 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:02.131152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:02.137594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:02.138601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:02.139082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:02.139761 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:02.140222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:02.140643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:02.169722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:02.170377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:02.177064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:02.178217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:02.178663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:02.180641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:02.181115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:02.181553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:02.244487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:02.253496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:02.255295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:02.256441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b8915ac-54d1-4167-b80e-15780c4cfc7a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.093160 Aug 08 17:24:02.257002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1132/2326] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:02 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:02.279909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:02.288011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ca0cda8e-d272-4a84-9ef8-ecbb1304e656 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.161654 Aug 08 17:24:02.288571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1195/2327] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:02 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:03.280350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:03.280972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:03.287406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:03.292266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:03.292266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:03.292266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:03.292266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:03.292652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:03.308936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:03.309645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:03.312137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=58 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:03.316720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:03.321159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:03.321159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:03.321159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:03.321159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:03.321552 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:03.355935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:03.365183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:03.366756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:03.367899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49f149de-9fa6-46cc-ba15-627ed35bdebf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.092068 Aug 08 17:24:03.368456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1133/2328] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:03.448743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:03.457419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-58d633d2-4e1d-4471-b039-449970bdcbbc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152800 Aug 08 17:24:03.458014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1196/2329] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:03 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:04.389826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:04.397228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:04.397228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:04.397228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:04.397675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:04.398389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:04.398842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:04.399266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:04.460832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:04.469212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:04.470745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:04.471873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-74abea9f-a111-402d-a3e6-79d621720d6e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086054 Aug 08 17:24:04.472437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1134/2330] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:04.479055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:04.479678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:04.486872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:04.487352 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:04.487794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:04.488490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:04.488952 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:04.489382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:04.617894 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:04.625868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8bbabc33-0bdc-417c-8d27-77f17bc5212a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150577 Aug 08 17:24:04.626429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1197/2331] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:05.494554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:05.495170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:05.502049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:05.502532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:05.502965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:05.503646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:05.504099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:05.504896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:05.565223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:05.573439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:05.574984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:05.576777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-920e9bd7-6d8f-4bc2-956b-c284efd77bfe tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086145 Aug 08 17:24:05.577325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1135/2332] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:05.647603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:05.648214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:05.654576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:05.655051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:05.655482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:05.656157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:05.656608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:05.657025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:05.786792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:05.794532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-70c3ae96-1e0e-41f1-b5b3-d270dd657dd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150803 Aug 08 17:24:05.795087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1198/2333] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:06.599291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:06.599905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:06.606291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:06.607256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:06.607684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:06.608396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:06.608855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:06.609267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:06.627867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:06.670849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:06.679075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:06.680561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:06.681684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ff2d5375-694f-4399-a31f-7d6e1c22fc54 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086272 Aug 08 17:24:06.682278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1136/2334] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:06.815186 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:06.815830 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:06.822604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:06.823093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:06.823528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:06.824245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:06.824696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:06.825119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:06.951723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:06.957592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5c0dd74c-e1e5-4a66-b608-687838c0699a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146282 Aug 08 17:24:06.958175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1199/2335] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:07.705534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:07.706181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:07.712577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:07.713062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:07.713503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:07.714223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:07.714683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:07.715112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:07.779146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:07.787502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:07.789014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:07.790182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4fc35a74-b5b5-44de-ab1e-61058d5d3efd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088533 Aug 08 17:24:07.790733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1137/2336] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:07.979003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:07.979626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:07.986042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:07.986527 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:07.986967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:07.987654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:07.988106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:07.988532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:08.006087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:08.117386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:08.125283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a9ba3fb2-da9b-4f70-8b24-01eb6a797e1d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150163 Aug 08 17:24:08.125868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1200/2337] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:07 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:08.812879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:08.813477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:08.819938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:08.820415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:08.820842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:08.821517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:08.821996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:08.822418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:08.882627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:08.890904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:08.892385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:08.893517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cdf19081-69b4-4a60-9820-d764670d4fc7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085115 Aug 08 17:24:08.894120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1138/2338] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:09.146175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:09.146706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:09.153081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:09.153556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:09.154018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:09.155193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:09.155642 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:09.156071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:09.287159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:09.295016 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6250e303-fa12-40b7-9e32-9de4cb2b7bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152764 Aug 08 17:24:09.296168 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1201/2339] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:09 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:09.915732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:09.916271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:09.922675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:09.923160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:09.923601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:09.924310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:09.924769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:09.925196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:09.987582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:09.995861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:09.997344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:09.998999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0e014cae-3949-4163-98c5-a8c51ef40d9d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086715 Aug 08 17:24:09.999541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1139/2340] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:10.317447 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:10.318092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:10.324457 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:10.324935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:10.325371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:10.326106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:10.326592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:10.327029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:10.453141 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:10.460948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c740f5a4-e4de-4ea7-b788-d3c3a6f683d0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147407 Aug 08 17:24:10.461509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1202/2341] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:10 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:11.021215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:11.021880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:11.028431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:11.028906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:11.029359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:11.030675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:11.031122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:11.031539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:11.090200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:11.099021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:11.100499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:11.101615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-325a93da-1e40-49f4-b89f-abecb2c4e398 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084482 Aug 08 17:24:11.102179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1140/2342] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:11.483638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:11.484286 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:11.491008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:11.491495 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:11.491932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:11.492623 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:11.493081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:11.493507 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:11.621762 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:11.630127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-014f9c59-c3d2-4641-abb2-a35c7b8a48c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150877 Aug 08 17:24:11.630708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1203/2343] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:12.124412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:12.124955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:12.131671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:12.133529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:12.133529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:12.133529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:12.133840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:12.134087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:12.197433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:12.206436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:12.207932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:12.209096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ea2dc062-a6f1-45b1-951c-d185724f252b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089255 Aug 08 17:24:12.209649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1141/2344] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:12.651209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:12.651824 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:12.658209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:12.658689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:12.659124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:12.659803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:12.660254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:12.660677 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:12.786498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:12.794369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5a3795e1-5602-4d42-bb1e-dcb0c484bedb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147072 Aug 08 17:24:12.794933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1204/2345] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:13.238866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:13.239481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:13.245880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:13.246371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:13.246812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:13.247507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:13.247962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:13.249044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:13.309983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:13.319023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:13.320521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:13.321649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-466bacb1-abed-46f5-a076-a80690101dfc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086772 Aug 08 17:24:13.322241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1142/2346] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:13 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:13.815657 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:13.816269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:13.822696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:13.823182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:13.823621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:13.824330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:13.824786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:13.825220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:13.955152 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:13.963037 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ce87257b-1d4b-4855-bf20-3ce0cd8133fe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151282 Aug 08 17:24:13.963594 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1205/2347] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:14.343693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:14.344314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:14.346671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:14.351386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:14.351874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:14.352312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:14.352996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:14.353450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:14.353904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:14.415245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:14.423512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:14.425003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:14.426170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-07035522-0e11-4d45-b41c-84bec47c9bf7 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086339 Aug 08 17:24:14.426745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1143/2348] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:14.985080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:14.985691 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:14.992263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:14.992735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:14.993166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:14.993862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:14.994317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:14.994738 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:15.120217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:15.128225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-42425b21-579e-4fce-a0b1-ba1387104adf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147505 Aug 08 17:24:15.128796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1206/2349] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:15.448629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:15.449242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:15.456214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:15.456696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:15.457135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:15.457838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:15.458294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:15.458717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:15.519072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:15.527583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:15.529084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:15.530875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f692e486-e75e-49bd-a87e-bd10ba605ce1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086248 Aug 08 17:24:15.531423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1144/2350] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:16.152575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:16.153202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:16.159226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:16.159714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:16.160165 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:16.160858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:16.161315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:16.161746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:16.292177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:16.300869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6b23be8c-bc31-43e8-8381-c9c6aa8b0eb7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154938 Aug 08 17:24:16.301434 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1207/2351] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:16 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:16.552593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:16.553203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:16.559282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:16.559767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:16.560199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:16.560897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:16.561330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:16.561752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:16.628050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:16.636600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:16.638100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:16.639223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3fbe05bd-baf5-4f73-b874-3e399c1bf1e6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090733 Aug 08 17:24:16.639786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1145/2352] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:17.322620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:17.323264 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:17.330255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:17.330735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:17.331171 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:17.331856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:17.332307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:17.332731 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:17.457603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:17.465415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-249b66f8-66b4-4efb-94c3-3ecf47641752 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146643 Aug 08 17:24:17.466000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1208/2353] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:17 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:17.661428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:17.662054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:17.668499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:17.668976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:17.669406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:17.670612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:17.671062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:17.671483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:17.730453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:17.739062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:17.740540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:17.741660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-71081556-e768-42c0-bccd-529e29da2893 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084101 Aug 08 17:24:17.742233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1146/2354] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:18.485971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:18.486585 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:18.492943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:18.493421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:18.493880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:18.494560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:18.495240 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:18.495668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:18.621750 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:18.629991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1a63987b-2cbd-4565-942d-eaef493f88cf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147827 Aug 08 17:24:18.630548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1209/2355] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:18.764975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:18.765591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:18.771948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:18.772426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:18.772860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:18.773544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:18.774023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:18.774450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:18.834371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:18.842545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:18.844027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:18.845148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21f5b604-0ff5-4393-921e-7ce85a2ee0c8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084720 Aug 08 17:24:18.845692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1147/2356] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:19.650686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:19.651303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:19.657662 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:19.658158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:19.658599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:19.659281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:19.659735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:19.660159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:19.788567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:19.796424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fec6d271-394a-44b6-a00d-8a7161b9f019 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149629 Aug 08 17:24:19.796991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1210/2357] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:19 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:19.866289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:19.866847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:19.873769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:19.874295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:19.874743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:19.875426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:19.875881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:19.876307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:19.935630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:19.944546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:19.946118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:19.947251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-682ea3bf-68cb-4f5f-8978-d6b7a8d4d6ac tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084869 Aug 08 17:24:19.947806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1148/2358] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:20.817772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:20.818509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:20.824843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:20.825318 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:20.825751 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:20.826451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:20.826901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:20.827321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:20.953401 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:20.961374 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-743df577-de1a-48e2-9d87-23bdfb3f7223 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147453 Aug 08 17:24:20.961970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1211/2359] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:20.969058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:20.969666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:20.975609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:20.976085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:20.976518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:20.977223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:20.977673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:20.978115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:21.041085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:21.049950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:21.051430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:21.052553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-45fa6860-b315-447e-87e7-e4516541e61d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087890 Aug 08 17:24:21.053091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1149/2360] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:21.983718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:21.984343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:21.990764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:21.991252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:21.991694 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:21.992473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:21.992877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:21.993306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:22.074780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:22.075427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:22.082818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:22.083306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:22.083748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:22.084445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:22.084902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:22.085331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:22.130994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:22.138867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-3bdad615-c133-4e60-9e30-10e15e29311a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.159065 Aug 08 17:24:22.142755 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1212/2361] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:21 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:22.154637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:22.164015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:22.167872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:22.167872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce33de16-98d0-409c-b153-36dc366042d2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.096684 Aug 08 17:24:22.168442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1150/2362] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:23.160242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:23.160858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:23.167237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:23.167714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:23.168150 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:23.168829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:23.169279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:23.169700 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:23.190263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:23.190875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:23.197080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:23.197562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:23.198062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:23.198749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:23.200676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:23.201624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:23.263563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:23.272775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:23.274330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:23.275493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a6662ea0-bb0d-4ace-a8f7-9879ac61fd9f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089108 Aug 08 17:24:23.276046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1151/2363] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:23 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:23.298465 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:23.306437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1e7860b5-a4d8-4612-8f3f-015b0b9675ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150071 Aug 08 17:24:23.311039 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1213/2364] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:23 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:24.299919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:24.300555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:24.307007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:24.307481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:24.307909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:24.308585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:24.309032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:24.309478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:24.330442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:24.331111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:24.337368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:24.337885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:24.338329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:24.339020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:24.339475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:24.339903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:24.371465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:24.381639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:24.383188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:24.384333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac874929-d40b-4e01-8c01-97193f224a8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088306 Aug 08 17:24:24.384888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1152/2365] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:24.467905 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:24.475746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-93054f70-f07a-4d4b-b804-5e6413391475 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149677 Aug 08 17:24:24.476329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1214/2366] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:24 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:25.407369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:25.407989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:25.414602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:25.415178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:25.415613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:25.416293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:25.416742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:25.417237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:25.422043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:25.481540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:25.489755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:25.491389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:25.492525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-908fc26e-d3c5-45a9-9a56-295e254da213 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089092 Aug 08 17:24:25.493167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1153/2367] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:25.496455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:25.497222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:25.504678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:25.505166 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:25.505607 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:25.506332 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:25.506800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:25.507231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:25.642730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:25.650519 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7a931f09-1313-4114-9efe-7fc42c893e42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.158012 Aug 08 17:24:25.651071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1215/2368] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:26.516092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:26.516696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:26.523370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:26.523845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:26.524274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:26.524946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:26.525394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:26.525839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:26.592173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:26.600687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:26.602155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:26.603286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e14e19f-9795-483f-894c-c5776f418889 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091723 Aug 08 17:24:26.603837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1154/2369] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:26.671643 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:26.672262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:26.678648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:26.679130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:26.679568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:26.680253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:26.680707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:26.681133 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:26.806387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:26.814988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0cb78453-3d48-41f2-bb46-74521e193306 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147686 Aug 08 17:24:26.815557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1216/2370] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:26 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:27.626187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:27.626795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:27.633997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:27.634476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:27.634915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:27.635592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:27.636041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:27.636459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:27.696747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:27.705729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:27.707294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:27.708430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f81689c8-76d1-4d00-8a87-28454d75c45e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086320 Aug 08 17:24:27.708982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1155/2371] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:27.836077 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:27.836695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:27.843172 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:27.843598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:27.844031 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:27.844714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:27.845169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:27.845598 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:27.849532 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:27.975887 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:27.983722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-10e1827f-b1de-4583-ace7-60cce047475a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151485 Aug 08 17:24:27.984285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1217/2372] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:28.731248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:28.731866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:28.738301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:28.738787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:28.739227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:28.739921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:28.740377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:28.740805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:28.800634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:28.808936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:28.810981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:28.812111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cbc524a1-9ab4-455c-a3be-c56dca693505 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084763 Aug 08 17:24:28.812661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1156/2373] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:29.004892 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:29.005509 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:29.011891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:29.012376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:29.012811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:29.013503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:29.013983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:29.014402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:29.140349 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:29.148146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e06b5298-c4dc-4859-adda-c25fd0423469 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147402 Aug 08 17:24:29.148705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1218/2374] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:28 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:29.834870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:29.835477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:29.842466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:29.842466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:29.842966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:29.843646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:29.844094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:29.844515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:29.911012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:29.919443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:29.921439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:29.922606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c06db7ba-0235-49a2-995e-e8659fda8be2 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091657 Aug 08 17:24:29.923158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1157/2375] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:30.168636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:30.169176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:30.176306 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:30.176792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:30.177231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:30.177946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:30.178403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:30.178833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:30.307957 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:30.315872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-71905067-e1c9-44d1-9618-7f32d7b7df11 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151230 Aug 08 17:24:30.316441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1219/2376] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:30 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:30.945060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:30.945615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:30.951954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:30.952439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:30.952880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:30.953569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:30.954080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:30.954517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:31.016926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:31.025123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:31.026636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:31.027756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3adaa011-dc47-41e5-8b90-067eb6c67033 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086690 Aug 08 17:24:31.028309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1158/2377] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:31.336430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:31.337047 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:31.345553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:31.346078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:31.346528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:31.347225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:31.347713 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:31.348145 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:31.476375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:31.484353 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-47f3f790-d6b5-48b3-9bc6-2d6b2c994e1c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151800 Aug 08 17:24:31.484917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1220/2378] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:31 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:32.050850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:32.051462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:32.057949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:32.058432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:32.058868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:32.059552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:32.060094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:32.061146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:32.123613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:32.132390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:32.133902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:32.135035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c141393-54f3-4970-86d9-88e10b087243 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088068 Aug 08 17:24:32.135590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1159/2379] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:32.506405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:32.507018 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:32.513385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:32.513912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:32.514351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:32.515054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:32.515492 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:32.515941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:32.651921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:32.666524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-386045d3-16c3-4b6b-812f-c3d71de78130 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.158266 Aug 08 17:24:32.666524 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1221/2380] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:33.157178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:33.157811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:33.164282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:33.164766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:33.165210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:33.165932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:33.166395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:33.166824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:33.227278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:33.235745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:33.237255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:33.238423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce9f186e-ce17-41ed-8e94-003c184e3614 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085160 Aug 08 17:24:33.238972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1160/2381] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:33 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:33.680802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:33.681439 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:33.683793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=52 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:33.688947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:33.689425 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:33.689891 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:33.690571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:33.691024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:33.691449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:33.817919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:33.825728 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fcf51b40-3bfe-4c4c-ac0d-58c9166d37f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148769 Aug 08 17:24:33.826311 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1222/2382] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:33 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:34.260421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:34.261033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:34.268084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:34.268561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:34.268996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:34.269677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:34.270159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:34.270581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:34.334088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:34.343101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:34.344613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:34.345752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1694d725-fe05-47d2-a135-eb4937339023 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089204 Aug 08 17:24:34.346331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1161/2383] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:34.846986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:34.847707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:34.854038 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:34.854531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:34.854974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:34.855674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:34.856135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:34.856570 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:34.987203 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:34.995329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0fd0dbf1-ebb6-4346-8725-3f1510fc86b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152225 Aug 08 17:24:34.996082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1223/2384] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:35.069343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:35.069867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:35.075667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.076650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.077077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.077828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.078286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.078704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.111493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:24:35.368155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:35.368681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:35.375019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.375502 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.375935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.376619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.377072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.377498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.397908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9710996-dd4a-4f55-a715-08c3ddb64f47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 204 len: 0 microversion: 2.1 time: 0.331991 Aug 08 17:24:35.398531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1162/2385] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:24:35 2022] DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:24:35.406952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:35.407640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:35.413862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.414121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.414559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.415240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:35.415694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:35.416112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:35.442902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:35.452786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:35.454423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:35.459576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cab28636-0265-4c87-9f2e-bdabbb5c86ba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091532 Aug 08 17:24:35.459576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1224/2386] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:35.548359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:35.556477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf178dd7-66b5-487e-b8c0-4bb879a118c5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153507 Aug 08 17:24:35.557042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1163/2387] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:36.017134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:36.017744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:36.024364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.024856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.025300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.026027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.026491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.026922 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.156530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:36.164432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb3e33e4-8c0d-4c0a-b4cd-16a89399c8c1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151736 Aug 08 17:24:36.164984 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1225/2388] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:36 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:36.477883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:36.478499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:36.485392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.485900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.486339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.487024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.487475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.487895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.547969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:36.556164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:36.557766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:36.558927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-73b275fc-e165-4077-84f8-fece4e1d9750 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084993 Aug 08 17:24:36.559483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1164/2389] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:36.578235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:36.578848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:36.584732 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.585205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.585635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.586348 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:36.586795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:36.587218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:36.711229 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:36.719543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-40b604c3-2967-4f76-8a01-3c2423c94d1b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145170 Aug 08 17:24:36.720109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1226/2390] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:37.192902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:37.193513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:37.199542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.200024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.200462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.201144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.201597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.202046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.332273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:37.340049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8dc786f9-c591-41e7-8a77-3ccc304f7e39 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150969 Aug 08 17:24:37.340605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1165/2391] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:37.581491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:37.582202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:37.588780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.589296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.589743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.590461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.590918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.591368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.655934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:37.664321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:37.665842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:37.666978 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-716fd994-a2bc-4010-8e7a-bead3049d75f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089371 Aug 08 17:24:37.667530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1227/2392] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:37.739847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:37.740453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:37.746797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.747281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.747710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.748410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:37.748857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:37.749277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:37.874351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:37.882406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-697a690d-44f6-41fe-8d8a-540fb8764981 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146373 Aug 08 17:24:37.882958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1166/2393] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:38.360468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:38.361085 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:38.367093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.367575 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.368010 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:38.368696 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.369153 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.369580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:38.496498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:38.505106 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f1b9cfa8-57be-40e0-9a12-88379e7e1580 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148499 Aug 08 17:24:38.505675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1228/2394] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:38.690122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:38.690758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:38.696730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.697207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.697640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:38.698348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.698804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.699225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:38.758248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:38.766542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:38.768048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:38.769167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5e36b876-4a30-44f7-88c1-2f2b8864a3fd tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083553 Aug 08 17:24:38.769722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1167/2395] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:38.903805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:38.904386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:38.910718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.911197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.911629 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:38.912307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:38.912763 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:38.913185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:39.037908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:39.046276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb18755b-ab72-4305-8d48-213f8081d8e4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146347 Aug 08 17:24:39.046837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1229/2396] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:39.527050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:39.527661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:39.533581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:39.534106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:39.534543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:39.535223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:39.535673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:39.536095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:39.540141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:39.665688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:39.674030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e29656a7-9ca2-477b-adb5-6af7eca2c9b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150825 Aug 08 17:24:39.674581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1168/2397] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:39.790850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:39.791402 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:39.798236 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:39.798721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:39.799160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:39.799841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:39.800296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:39.800723 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:39.862914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:39.871245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:39.872725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:39.873935 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-45878755-662d-42a7-8d1e-08d5694da07f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086965 Aug 08 17:24:39.874484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1230/2398] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:40.066924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:40.067524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:40.073874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.074359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.074792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.075463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.076399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.076826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.202540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:40.210443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-36a07657-0cf9-495d-8009-9ae5d4cdb803 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147330 Aug 08 17:24:40.211009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1169/2399] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:40.695406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:40.696019 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:40.702371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.702849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.703284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.703994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.704448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.704866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.833451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:40.841405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-acccf12c-40dc-4411-993e-04eae704d5a0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149865 Aug 08 17:24:40.842567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1231/2400] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:40 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:40.896311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:40.896958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:40.902856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.903338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.903775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.905100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:40.905557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:40.906018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:40.969034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:40.977298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:40.978806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:40.979926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2dcb29b-64f2-4141-9a9a-6040ec88ed19 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087665 Aug 08 17:24:40.980479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1170/2401] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:41.232201 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:41.232816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:41.238781 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:41.239255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:41.239684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:41.240363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:41.240814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:41.241232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:41.364921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:41.373339 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9a06ceaf-f7e1-42a5-954a-f1a0363dd559 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.144456 Aug 08 17:24:41.373917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1232/2402] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:41.862280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:41.862855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:41.869126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:41.869609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:41.870078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:41.870773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:41.871236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:41.871659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:41.999403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:42.002578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:42.003482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:42.008117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bf089a8c-f968-4ad7-bb28-fadf9fdf91c3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149706 Aug 08 17:24:42.008689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1171/2403] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:42.009780 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:42.010293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:42.010741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:42.011431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:42.011889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:42.012317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:42.075653 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:42.079656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:42.084850 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:42.086375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:42.087726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4d7ff00a-914d-4332-8433-8f61d8ceeed5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088850 Aug 08 17:24:42.088058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1233/2404] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:41 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:42.394864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:42.395478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:42.401561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:42.402075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:42.402511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:42.403190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:42.403644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:42.404703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:42.530741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:42.538599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b2daa543-ade1-4179-ba4a-162b7d30ec49 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147537 Aug 08 17:24:42.539190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1172/2405] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:43.030327 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:43.030970 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:43.037501 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.038109 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.038558 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.039255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.039744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.040177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.110059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:43.110666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:43.116905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.117546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.117817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.118514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.118960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.119378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.167639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:43.176217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-472b2468-073f-47cd-9265-2c0c528dd699 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150151 Aug 08 17:24:43.176779 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1234/2406] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:43.186280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:43.194676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:43.196204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:43.197335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-36cc8bbc-32e6-4e3f-9816-c9b097983b2d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.091767 Aug 08 17:24:43.197908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1173/2407] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:43 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:43.559906 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:43.560518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:43.566382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.566862 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.567294 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.567977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:43.568427 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:43.568845 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:43.695272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:43.703055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-5cb0d11f-ff19-4c89-a807-3ce167ec6221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147017 Aug 08 17:24:43.703619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1235/2408] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:44.197039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:44.199468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:44.211269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.211789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.212233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.212960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.213404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.213853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.219736 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:44.220379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:44.226674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.227162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.227593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.228279 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.228741 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.229174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.303753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:44.312316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:44.313849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:44.315005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-00559cb8-ec1e-4003-925c-f732684eb82c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.099648 Aug 08 17:24:44.315564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1236/2409] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:44 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:44.352740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:44.361196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4980afdc-af42-442d-8aed-837beb5b71c6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.168005 Aug 08 17:24:44.361760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1174/2410] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:44.725025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:44.725675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:44.731656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.732266 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.732640 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.733330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:44.733811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:44.734245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:44.859756 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:44.867613 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f0d3af05-a942-463c-acde-275723d487ba tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146456 Aug 08 17:24:44.868181 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1237/2411] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:45.337205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:45.337957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:45.340294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:45.345548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.346193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.346636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:45.347325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.347847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.348398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:45.382562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:45.383185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:45.390069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.390557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.391001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:45.391704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.392161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.392587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:45.411433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:45.419810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:45.421307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:45.422478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2c73189e-8d28-49db-8dce-9570db7bd24d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089318 Aug 08 17:24:45.423015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1175/2412] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:45 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:45.522586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:45.531310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8bd0a774-c40b-4fd7-a5f8-4a2491e700af tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152588 Aug 08 17:24:45.531877 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1238/2413] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:45.889070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:45.889684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:45.896062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.896542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.896974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:45.897647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:45.898121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:45.898540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:46.028084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:46.035899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e46d1d69-ab2c-4719-8e3d-fdcb1d3d970a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151327 Aug 08 17:24:46.036456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1176/2414] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:46.444819 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:46.445431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:46.451753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:46.452233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:46.452682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:46.453340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:46.453803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:46.454234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:46.516328 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:46.524578 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:46.526082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:46.527215 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2b4cc517-e0c9-4c78-a453-1f7459e44490 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086298 Aug 08 17:24:46.527776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1239/2415] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:46 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:46.552159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:46.552709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:46.558873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:46.559353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:46.559790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:46.560502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:46.560959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:46.561383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:46.687503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:46.695322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7842d05-42cd-4676-8607-4b31957ccdef tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147071 Aug 08 17:24:46.695878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1177/2416] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:46 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:47.056735 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:47.057355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:47.063329 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.063808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.064248 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.064927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.065408 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.065857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.190852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:47.198695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1c410b80-6a13-4a19-b672-36e9edcca0ea tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145771 Aug 08 17:24:47.199261 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1240/2417] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:47.550264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:47.550866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:47.557259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.557834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.558177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.558856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.559303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.559723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.620696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:47.629911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:47.631406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:47.632529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6aaf974a-d747-4289-a367-bbe36702c96e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086194 Aug 08 17:24:47.633119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1178/2418] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:47 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:47.715841 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:47.716430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:47.722775 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.723255 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.723695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.724383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:47.724838 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:47.725263 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:47.851080 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:47.859535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-718bea65-cdce-475c-a34f-2975cdd5533e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147514 Aug 08 17:24:47.860104 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1241/2419] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:47 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:48.220880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:48.221490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:48.227422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.227903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.228334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:48.229007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.229453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.229907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:48.359096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:48.366980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-003e5f36-2aea-49fa-8138-f43c76974ca3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149896 Aug 08 17:24:48.367551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1179/2420] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:48.655479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:48.656100 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:48.662081 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.662564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.663001 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:48.663685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.664138 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.664561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:48.726556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:48.734729 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:48.736222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:48.737350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-734f7e7b-e7f1-49fa-a223-963c8ebacf2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086438 Aug 08 17:24:48.737946 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1242/2421] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:48 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:48.881175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:48.881725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:48.888822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.889307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.889744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:48.890458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:48.890916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:48.891342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:49.016683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:49.024519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f9cff297-1995-43f5-9168-6321bfec11cd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147469 Aug 08 17:24:49.025082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1180/2422] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:48 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:49.388122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:49.388739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:49.394684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:49.395169 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:49.395608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:49.396292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:49.396748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:49.397174 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:49.526384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:49.535740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0944f230-8d36-4bdd-8679-1b0e3aa84b94 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151509 Aug 08 17:24:49.536309 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1243/2423] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:49.760076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:49.760614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:49.766519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:49.766990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:49.767417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:49.768088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:49.768536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:49.768953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:49.830669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:49.838895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:49.840392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:49.842232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77b19348-e2b2-438b-b54f-fbd7c1429985 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086055 Aug 08 17:24:49.842816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1181/2424] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:49 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:50.044369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:50.044917 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:50.051289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.051771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.052209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.052900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.053357 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.053811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.179683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:50.188075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-50710bc3-75cf-4614-b529-d6de9c54cc99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147585 Aug 08 17:24:50.188634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1244/2425] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:50.557414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:50.557986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:50.565094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.565572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.566028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.566703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.567148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.567566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.698271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:50.706147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7f000a0-2bd8-4021-be1e-5930d81a796f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152647 Aug 08 17:24:50.706714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1182/2426] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:50.864301 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:50.864855 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:50.870893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.871378 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.871816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.872500 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:50.872956 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:50.873389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:50.942911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:50.956074 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:50.958324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:50.959759 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e03d9f9f-5dd1-4213-86e8-abcd8d480107 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.099381 Aug 08 17:24:50.960551 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1245/2427] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:50 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:51.208765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:51.209283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:51.215182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.215657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.216087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:51.217252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.217698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.218140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:51.345250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:51.353045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dcbff5a7-85fe-42d5-bbd8-49f52f082925 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148161 Aug 08 17:24:51.353600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1183/2428] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:51.727105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:51.727720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:51.734821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.735299 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.735733 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:51.736411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.736860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.737281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:51.861476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:51.869275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-373442e6-732d-4f22-a13b-536b1e9ab998 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146062 Aug 08 17:24:51.869849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1246/2429] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:51.987200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:51.987820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:51.994338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.994825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.995261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:51.995951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:51.996409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:51.996837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:52.057052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:52.060458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:52.065647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:52.067216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:52.072426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4dc5a1e4-d388-48df-8874-f039db2fd2df tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085143 Aug 08 17:24:52.072426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1184/2430] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:51 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:52.374416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:52.375066 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:52.381489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:52.382045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:52.382487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:52.383205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:52.383661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:52.384087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:52.509542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:52.517553 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-56b50c62-4367-4b0d-962b-30fe6aa84654 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147540 Aug 08 17:24:52.518157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1247/2431] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:52.890713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:52.891259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:52.897424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:52.897930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:52.898366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:52.899044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:52.899490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:52.899908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:53.027930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:53.035804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2bb783b-7fab-42ce-be5e-2ec7b7edd7ca tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149314 Aug 08 17:24:53.036368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1185/2432] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:53.090898 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:53.091540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:53.097848 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:53.098333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:53.098774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:53.099460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:53.099914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:53.100340 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:53.163246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:53.172068 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:53.173565 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:53.174727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4f4d8203-0108-4477-a008-203ad8320824 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087665 Aug 08 17:24:53.175285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1248/2433] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:53 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:53.539866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:53.540537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:53.547182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:53.547661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:53.548092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:53.548772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:53.549223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:53.549651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:53.676234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:53.684073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-833e3df9-25fb-40a1-88d1-6b3c6bdf0501 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148116 Aug 08 17:24:53.684640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1186/2434] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:53 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:54.057603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:54.058246 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:54.064918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.065403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.065858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.066550 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.067002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.067423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.193525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:54.196387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:54.197003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:54.202438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7f4abb77-948b-4f56-b061-fe18a14aa398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148633 Aug 08 17:24:54.203295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1249/2435] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:54.203880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.204373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.204808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.205497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.205982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.206406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.270860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:54.279120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:54.280615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:54.281737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19a9b84d-7ed8-41c9-ab31-4abe9ccc5782 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089239 Aug 08 17:24:54.282314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1187/2436] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:54 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:54.705586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:54.706226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:54.712367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.712844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.713277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.713986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:54.714455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:54.714880 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:54.733409 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:24:54.839205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:54.847428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-1ca8dc6c-b9fb-4f29-b194-6a766c65d37e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145683 Aug 08 17:24:54.847991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1250/2437] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:54 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:55.223658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:55.224266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:55.230601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.231075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.231505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:55.232186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.232633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.233051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:55.303927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:55.304539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:55.310963 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.311442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.311873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:55.312557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.313012 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.313435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:55.360146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:55.368696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-37a57080-331c-4c2f-bf3e-1e76956c8a7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148762 Aug 08 17:24:55.369266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1188/2438] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:55.378556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:55.387126 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:55.389223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:55.390390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-97f4d4e9-d0ec-48f7-ad66-e25c8804c899 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090440 Aug 08 17:24:55.390938 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1251/2439] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:55 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:55.868386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:55.868918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:55.875746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.876221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.876651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:55.877591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:55.878067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:55.878488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:56.004418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:56.012198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-94a12b08-1df0-426b-9760-3b3b7980d9ba tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147727 Aug 08 17:24:56.012750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1189/2440] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:55 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:56.390774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:56.391400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:56.397979 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:56.398469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:56.398910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:56.399603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:56.400090 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:56.400521 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:56.412842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:56.413448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:56.419702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:56.420180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:56.420609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:56.421288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:56.421736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:56.422190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:56.486896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:56.495509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:56.496989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:56.498635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-476e14ce-18e0-4174-aab0-2be2198d9131 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089687 Aug 08 17:24:56.499185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1190/2441] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:56 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:24:56.531257 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:56.539214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0924a43f-d48f-4c74-b726-547511405994 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152901 Aug 08 17:24:56.539769 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1252/2442] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:57.033161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:57.033770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:57.039708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.040187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.040621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.041297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.041744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.042182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.168786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:57.177581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db0a01d2-1a63-4317-b6cf-95aca513e0b8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149031 Aug 08 17:24:57.178166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1191/2443] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:57.520467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:57.521076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:57.527494 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.527999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.528435 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.529678 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.530155 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.530581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.559953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:57.560556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:57.566968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.567452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.567884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.568570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:57.569014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:57.569430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:57.592147 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:57.600654 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:57.602170 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:57.603310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ade5cc51-b944-455b-8e1d-8312ea94b85a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086778 Aug 08 17:24:57.603867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1253/2444] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:57 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:57.697680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:57.706184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fcf22366-f9b8-41f1-9d94-b82357e180ad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149955 Aug 08 17:24:57.706735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1192/2445] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:24:58.198175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:58.198796 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:58.204705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.205188 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.205634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.206360 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.206837 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.207265 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.334719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:58.342635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fe9f51c5-3319-42b6-aae0-b74d3cb77b19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148287 Aug 08 17:24:58.343192 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1254/2446] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:58.625880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:58.626493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:58.633150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.633633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.634105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.634784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.635236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.635660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.698582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:58.707059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:58.708631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:58.709756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3fc3af1f-9ba0-4cd3-8e4d-353585b25fb6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087867 Aug 08 17:24:58.710324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1193/2447] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:58 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:58.726376 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:58.726999 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:58.734093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.734583 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.735027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.735719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:58.736179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:58.736610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:58.863919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:58.871836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-66533d63-6abe-471c-8e76-cdd961acd5cb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149237 Aug 08 17:24:58.872448 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1255/2448] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:59.363725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:59.364337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:59.370249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.370731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.371169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:59.371848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.372303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.372725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:59.500703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:59.509000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c6f77e7-e35e-4bbf-8e6d-72cdbb70d026 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149149 Aug 08 17:24:59.509560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1194/2449] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:24:59.732233 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:59.732842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:59.739196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.739680 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.740114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:59.740797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.741253 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.741685 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:59.801903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:59.810222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:59.811718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:24:59.812854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e2f9e394-e250-4c5b-beee-0e34184e3f1d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084567 Aug 08 17:24:59.813406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1256/2450] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:24:59 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:24:59.896169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:24:59.896765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:24:59.903158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.904267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.904702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:24:59.905385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:24:59.905858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:24:59.906281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:00.031148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:00.038963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cde05a9e-c1f6-415c-8080-ea8796498267 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146642 Aug 08 17:25:00.039519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1195/2451] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:24:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:00.535476 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:00.536094 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:00.542281 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:00.542776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:00.543222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:00.543927 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:00.544385 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:00.544815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:00.675795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:00.683608 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-35d3aaf7-7f68-4b3b-9abd-f699dc892ad8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154875 Aug 08 17:25:00.684179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1257/2452] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:00.835118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:00.835724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:00.841813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:00.842224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:00.842655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:00.843324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:00.843772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:00.844189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:00.907338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:00.915562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:00.917051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:00.918213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68c332e9-946c-4640-93b4-7441032ec2bb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086912 Aug 08 17:25:00.918763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1196/2453] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:00 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:01.060582 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:01.061202 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:01.067689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.068178 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.068620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:01.069310 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.069770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.070222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:01.197943 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:01.205818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-125b63c6-2e97-4df2-a330-1877cae315cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149654 Aug 08 17:25:01.206386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1258/2454] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:01.704799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:01.705415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:01.711446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.711926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.712362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:01.713040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.713494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.713947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:01.842622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:01.850407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1174346f-b1a9-4e13-8520-d767844967c9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149401 Aug 08 17:25:01.850970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1197/2455] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:01.940065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:01.940675 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:01.946528 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.947009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.947444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:01.948125 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:01.948576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:01.948998 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:02.012343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:02.021604 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:02.023119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:02.024252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-16934c66-45e9-4f37-8bf4-3b930ba445f8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088028 Aug 08 17:25:02.024793 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1259/2456] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:01 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:02.226892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:02.227533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:02.234608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:02.235091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:02.235523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:02.236338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:02.236798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:02.237221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:02.363410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:02.371510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28453068-6c87-4cbf-a2ca-332b805b95bb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148436 Aug 08 17:25:02.372111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1198/2457] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:02.871543 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:02.872743 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:02.879404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:02.879883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:02.880320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:02.881009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:02.881469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:02.881918 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:03.012128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:03.020049 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c6611598-8b9a-41c8-bd35-7bbe0dca8e0a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152641 Aug 08 17:25:03.020616 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1260/2458] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:02 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:03.047558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:03.048162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:03.054230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:03.054711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:03.055146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:03.055829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:03.056281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:03.056707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:03.119963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:03.128642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:03.130098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:03.131230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54f89d39-1f2b-46f8-bd1f-fefc9b0c037a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088031 Aug 08 17:25:03.131778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1199/2459] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:03 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:03.394063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:03.394664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:03.400559 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:03.401043 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:03.401484 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:03.402197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:03.402652 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:03.403076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:03.528794 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:03.536801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d72af14c-8e9c-4e3e-b126-a58329675544 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146728 Aug 08 17:25:03.537410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1261/2460] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:04.041829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:04.042452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:04.049479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.049997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.050435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.051118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.051571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.051998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.152498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:04.153117 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:04.157119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=80 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:04.160563 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.161064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.161511 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.162238 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.162730 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.163162 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.185554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:04.193732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6cd3db6d-f5bd-4d56-8270-87fc904d598f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155781 Aug 08 17:25:04.194519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1200/2461] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:04.223962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:04.232242 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:04.233744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:04.234902 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-c5806e93-84c1-4c85-8368-b284be87e319 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086333 Aug 08 17:25:04.235453 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1262/2462] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:04 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:04.557964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:04.558502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:04.564429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.564911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.565343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.566057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:04.566512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:04.566932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:04.584900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:04.693412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:04.701339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92ce8431-87d4-450b-beff-7e03a50a82cd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147330 Aug 08 17:25:04.701922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1201/2463] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:05.215305 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:05.215912 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:05.222303 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.222786 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.223225 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.223908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.224363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.224792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.257026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:05.257730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:05.264851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.265267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.265697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.266408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.266859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.267285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.331661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:05.340009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:05.341591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:05.342779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6978d1b6-4884-4926-9d9d-539989669c22 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089536 Aug 08 17:25:05.344130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1202/2464] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:05 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:05.358232 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:05.365531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9dfbe352-ffa1-429f-8e0e-165fcc931b01 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154061 Aug 08 17:25:05.366176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1263/2465] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:05.722207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:05.722817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:05.728652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.729130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.729559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.730284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:05.730728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:05.731632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:05.854844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:05.863395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a3dc3349-e113-4255-b551-9b257c6a3a8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.144931 Aug 08 17:25:05.863957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1203/2466] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:06.365058 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:06.365665 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:06.372076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.372556 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.372987 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:06.373661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.374143 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.374562 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:06.387508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:06.388127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:06.395046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.395532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.395968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:06.396660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.397117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.397540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:06.434914 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:06.443456 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:06.444972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:06.446149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4aa7de6e-c48b-4d63-9bb8-a83d987a11aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084918 Aug 08 17:25:06.446712 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1264/2467] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:06 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:06.527969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:06.536698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03ded20d-21c7-4250-a825-b3c6734135d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153016 Aug 08 17:25:06.537258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1204/2468] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:06.885371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:06.885973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:06.892726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.893211 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.893655 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:06.894366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:06.894829 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:06.895259 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:07.022777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:07.030609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a09d6fd9-27e2-4c99-95fc-05f96b879737 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149233 Aug 08 17:25:07.031177 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1265/2469] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:07.471280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:07.471879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:07.478282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:07.478759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:07.479187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:07.479865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:07.480312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:07.480731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:07.544055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:07.553108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:07.554637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:07.555769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2909397f-c935-4584-be3b-7a5dad5d7795 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088356 Aug 08 17:25:07.556318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1205/2470] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:07 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:07.557727 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:07.558375 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:07.564742 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:07.565599 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:07.566069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:07.566767 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:07.567224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:07.567651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:07.698410 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:07.706674 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39d18bc6-8ef7-4884-b58d-84de24333ca2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153017 Aug 08 17:25:07.707234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1266/2471] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:07 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:08.051501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:08.052115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:08.058145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.058629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.059061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.059771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.060226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.060648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.187998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:08.195860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-72eb5703-cc96-492d-9b80-f051c89da3f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148160 Aug 08 17:25:08.196422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1206/2472] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:08.577833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:08.578371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:08.584706 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.585190 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.585631 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.586350 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.586816 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.587243 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.591285 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:08.648560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:08.656857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:08.658395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:08.659539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4a09182a-a09c-426f-98ea-63d974320c42 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085675 Aug 08 17:25:08.660107 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1267/2473] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:08 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:08.727890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:08.728497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:08.735344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.735816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.736252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.736925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:08.737372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:08.737805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:08.863331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:08.871187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e5261619-4072-4b06-ac53-fc19291e3855 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147069 Aug 08 17:25:08.871750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1207/2474] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:09.217760 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:09.218399 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:09.224296 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.224777 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.225209 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:09.225921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.226373 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.226795 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:09.358667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:09.366580 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6d5426b0-1647-42a1-a3ae-bac17a7ad807 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153168 Aug 08 17:25:09.367139 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1268/2475] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:09.683485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:09.684103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:09.690714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.691203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.691642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:09.692322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.692779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.693220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:09.756412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:09.765475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:09.767014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:09.768150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f35c38c2-92c7-4210-8332-40f5a7f60643 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088586 Aug 08 17:25:09.768709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1208/2476] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:09 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:09.893420 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:09.894024 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:09.900389 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.900869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.901308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:09.902030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:09.902486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:09.902911 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:10.027776 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:10.036128 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-51a8a5a8-c24b-4a48-813c-0e8649a8aea7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146578 Aug 08 17:25:10.036690 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1269/2477] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:09 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:10.387964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:10.389066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:10.394955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:10.395428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:10.395857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:10.396524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:10.396972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:10.397393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:10.523219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:10.531545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e6ee3a3-d1a9-410a-bafa-1b23bb1a5046 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147366 Aug 08 17:25:10.532109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1209/2478] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:10.789315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:10.789994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:10.796371 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:10.796854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:10.797292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:10.798002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:10.798459 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:10.798884 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:10.858217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:10.866621 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:10.868135 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:10.869271 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f67d69c1-8538-4ca8-954e-4c56ca82d308 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083842 Aug 08 17:25:10.869844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1270/2479] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:10 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:11.057578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:11.058218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:11.065273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.065756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.066218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.066898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.067351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.067810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.196680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:11.204620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-157ee19f-7eb5-440a-8b62-cdac9ab51338 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150862 Aug 08 17:25:11.205177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1210/2480] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:11.552365 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:11.552983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:11.559808 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.560288 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.560718 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.561393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.561900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.562325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.691455 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:11.699362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-25a3040f-d3fc-4720-b1f8-6762557abd72 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150786 Aug 08 17:25:11.699915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1271/2481] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:11.893166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:11.893697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:11.900209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.900761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.901190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.901892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:11.902340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:11.902759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:11.968711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:11.977215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:11.978745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:11.979861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09f8c99a-6f19-4635-ab8f-a7e70be52a95 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.090630 Aug 08 17:25:11.980407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1211/2482] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:11 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:12.225971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:12.226595 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:12.232518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:12.233005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:12.233441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:12.234164 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:12.234619 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:12.235040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:12.361025 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:12.368973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7bd4cf45-5164-418d-beb5-12a32574df72 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146911 Aug 08 17:25:12.369530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1272/2483] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:12.721447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:12.722112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:12.728596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:12.729078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:12.729511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:12.730224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:12.730678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:12.731101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:12.856510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:12.864961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84896ac5-a3aa-4b18-9f7b-f5ba6eac76a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147390 Aug 08 17:25:12.865519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1212/2484] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:13.002127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:13.002764 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:13.009124 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.009601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.010069 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:13.010752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.011204 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.011627 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:13.071064 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:13.079695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:13.081176 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:13.082335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-e3b892fa-398e-4c91-8b6b-43fbe4a48f75 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084332 Aug 08 17:25:13.082886 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1273/2485] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:12 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:13.390734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:13.391338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:13.397367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.397867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.398303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:13.398974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.399421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.399840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:13.527149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:13.535010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-388697fa-1f3a-4046-8626-e11df92f0428 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148551 Aug 08 17:25:13.535568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1213/2486] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:13.886082 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:13.886707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:13.893098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.893576 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.894057 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:13.894739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:13.895197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:13.895622 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:14.025390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:14.033844 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a708b96c-23f6-42fb-9a9e-da152f5fb9a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151622 Aug 08 17:25:14.034404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1274/2487] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:14.104935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:14.105547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:14.111926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:14.112409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:14.112846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:14.113550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:14.114016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:14.114440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:14.177663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:14.186564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:14.188081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:14.189224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75def9cb-0276-47f2-9365-90d7b33c53cc tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088221 Aug 08 17:25:14.189772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1214/2488] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:14 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:14.556486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:14.557098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:14.564217 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:14.564707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:14.571116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:14.571116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:14.571116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:14.571116 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:14.694885 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:14.702770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b3541c22-b44f-4df4-9314-328d229dedec tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150254 Aug 08 17:25:14.703343 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1275/2489] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:15.055099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:15.055712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:15.061670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.062184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.062619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.063296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.063748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.064171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.189174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:15.197171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-26a3cd35-d8d8-4a14-be19-f9e7486739e8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145873 Aug 08 17:25:15.197739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1215/2490] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:15.211815 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:15.212432 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:15.219390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.219875 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.220317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.221008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.221493 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.221949 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.282900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:15.291219 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:15.292721 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:15.293883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-4694c62b-35f1-4a2e-8b49-8712df86a8cf tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085848 Aug 08 17:25:15.295070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1276/2491] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:15 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:15.723868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:15.724509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:15.730430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.730904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.731331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.732000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:15.732451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:15.732870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:15.859379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:15.867256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ace7e658-b416-4fc9-b3b2-94e861ee67bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147257 Aug 08 17:25:15.867817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1216/2492] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:16.218667 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:16.219289 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:16.225460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.225983 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.226424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:16.227111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.227574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.228002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:16.317122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:16.317774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:16.319832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=84 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:16.324474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.324961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.325432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:16.326156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.326619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.327044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:16.358566 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:16.366720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a3ab0ec5-c224-4173-a816-066ab3b4a864 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151865 Aug 08 17:25:16.367292 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1277/2493] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:16.391643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:16.400182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:16.401694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:16.402868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fdcd75f9-07cd-46cf-84fb-ca67f13c226d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089613 Aug 08 17:25:16.403985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1217/2494] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:16 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:16.889355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:16.889950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:16.895990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.896470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.896908 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:16.897593 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:16.898071 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:16.898496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:17.023400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:17.031874 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cc56e809-0e54-4f03-9cb2-c4492ce1562a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146965 Aug 08 17:25:17.032441 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1278/2495] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:16 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:17.389395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:17.390032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:17.396418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:17.396903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:17.397353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:17.398056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:17.398515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:17.398943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:17.402817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:17.424449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:17.425087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:17.431205 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:17.431689 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:17.432130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:17.432818 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:17.433277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:17.433704 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:17.498903 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:17.507512 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:17.509113 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:17.510362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-730246f3-894c-4861-9de0-06cadb98ce41 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089834 Aug 08 17:25:17.510915 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1279/2496] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:17 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:17.527769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:17.535727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b716473d-8cac-46bd-b5de-b07c0a968090 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150860 Aug 08 17:25:17.536284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1218/2497] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:18.052639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:18.053256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:18.059220 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.059695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.060127 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.060800 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.061250 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.061670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.424646 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:18.432972 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-aa77541a-0aee-4366-b098-b3e6b4da206c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.384436 Aug 08 17:25:18.433534 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1280/2498] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:18.533293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:18.533922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:18.541218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.542099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.542534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.543212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.543662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.544081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.556325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:18.557035 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:18.563382 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.563810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.564254 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.564989 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:18.565482 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:18.566103 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:18.607870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:18.616381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:18.617913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:18.619092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-003659e9-36bb-4b0e-97df-cb14c81286a3 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089652 Aug 08 17:25:18.619648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1219/2499] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:18 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:18.697854 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:18.706384 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-874adc91-e0dc-40d0-93b0-7aa95b03a6a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153861 Aug 08 17:25:18.706948 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1281/2500] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:19.453219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:19.455066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:19.461268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.461735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.462193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.462877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.463357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.463777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.599310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:19.608077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9180adae-cd4d-4a0e-bfbf-dad4e5ac878b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.158807 Aug 08 17:25:19.608650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1220/2501] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:19 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:19.640993 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:19.641587 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:19.647668 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.648149 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.648586 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.649269 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.649753 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.650198 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.718411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:19.727498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:19.727703 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:19.728139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:19.729237 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:19.730403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f8b7a932-4073-48c7-8677-f30333d12d96 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.093864 Aug 08 17:25:19.731111 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1282/2502] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:19 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:19.734810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.735261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.735695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.736382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:19.736835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:19.737260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:19.848163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:25:19.848401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:25:19.874247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:19.883221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d166f257-beb1-49cd-8e42-4785e78947ec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.159572 Aug 08 17:25:19.883803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1221/2503] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:20.629588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:20.630226 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:20.636108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.636635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.637065 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:20.637746 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.638214 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.638637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:20.759654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:20.760450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:20.766965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:20.767452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.767627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.768137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:20.768838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.769299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.769723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:20.770530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:20.775321 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2088c71a-d141-476d-8774-9fa82cbbc06d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149955 Aug 08 17:25:20.775974 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1283/2504] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:20.834136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:20.842796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:20.844297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:20.845438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84c22264-568b-4926-ae28-e538f1979547 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089885 Aug 08 17:25:20.846034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1222/2505] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:20 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:20.904856 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:20.905469 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:20.911919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.912395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.912827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:20.913505 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:20.914002 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:20.914424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:21.041896 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:21.050430 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ed13349f-9d36-462d-b378-82108d08108d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149901 Aug 08 17:25:21.050975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1284/2506] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:21.796363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:21.797002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:21.803966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:21.804450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:21.804884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:21.805569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:21.806043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:21.806467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:21.868260 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:21.868827 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:21.875934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:21.876684 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:21.877130 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:21.877858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:21.878324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:21.878757 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:21.940869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:21.951134 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:21.952744 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:21.953995 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb106da8-78a9-4168-83eb-174a321cd25c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.089706 Aug 08 17:25:21.957091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:21.957444 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1285/2507] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:21 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:21.965272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c13fa30-b5bd-42ba-9f2f-16ecb1486485 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.172745 Aug 08 17:25:21.965873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1223/2508] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:21 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:22.072645 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:22.073268 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:22.079223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:22.079717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:22.080159 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:22.080853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:22.081314 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:22.081745 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:22.209954 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:22.217991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-f833c906-056b-459c-b55c-c70b522529d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149146 Aug 08 17:25:22.219009 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1286/2509] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:22.976492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:22.977102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:22.983526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:22.984008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:22.984442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:22.985126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:22.985581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:22.986057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:22.992752 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:22.993504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:22.999847 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:23.000330 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:23.000866 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:23.001839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:23.002293 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:23.002714 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:23.047780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:23.056282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:23.057770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:23.058920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1a78b70-efef-4f7e-b87e-aae1d30f9b2f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086358 Aug 08 17:25:23.059507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1224/2510] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:22 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:23.133852 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:23.141734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d861eef6-3ea9-4a70-beb4-c30707b764a7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152737 Aug 08 17:25:23.142317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1287/2511] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:22 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:23.239899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:23.240475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:23.246438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:23.246923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:23.247362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:23.248049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:23.248506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:23.248935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:23.374067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:23.382322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae90d475-478f-45da-88b6-5444fb9e9cee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146282 Aug 08 17:25:23.382905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1225/2512] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:24.081144 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:24.081904 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:24.088411 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.088888 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.089335 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.090119 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.090666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.091098 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.151355 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:24.159797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:24.161307 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:24.162486 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8bfa06cf-ab8e-444d-8e11-50fb0e4494d5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085279 Aug 08 17:25:24.162836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:24.163345 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1288/2513] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:24 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:24.163449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:24.169900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.170371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.170798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.171473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.171919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.172341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.299916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:24.307673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05b58bef-3b41-4f03-bfdc-a93913f343aa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148631 Aug 08 17:25:24.308256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1226/2514] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:24 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:24.403280 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:24.403936 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:24.409872 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.410362 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.410805 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.411498 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:24.411962 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:24.412398 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:24.536928 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:24.545316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d0f50da0-d25c-4aea-a8ba-58ef72f34d65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145938 Aug 08 17:25:24.546224 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1289/2515] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:25.184214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:25.184830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:25.191235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.191787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.192233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.192911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.193364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.193810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.255943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:25.264795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:25.266323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:25.267454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05d47d4e-5bb5-47fb-b69f-1ea621fba3aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087159 Aug 08 17:25:25.268011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1227/2516] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:25 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:25.329944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:25.330591 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:25.336901 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.337393 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.337839 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.338525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.338977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.339405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.469637 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:25.477475 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-59641395-200d-40b5-83c7-6a8478a4f2b6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151379 Aug 08 17:25:25.478073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1290/2517] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:25.566207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:25.566823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:25.572665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.573143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.573574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.574276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:25.574730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:25.575717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:25.699518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:25.708055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e656d84-27f3-4784-9f2b-6cf310c13886 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145601 Aug 08 17:25:25.708557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1228/2518] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:26.290284 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:26.290900 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:26.297377 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.297895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.298337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.299021 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.299504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.299932 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.360245 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:26.368490 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:26.370020 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:26.371151 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-ad59b064-c1a8-4d4e-8e06-b2f0371b68ce tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084808 Aug 08 17:25:26.371708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1291/2519] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:26 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:26.498362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:26.499009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:26.505645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.506161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.506598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.507281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.507734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.508155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.639395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:26.647260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0c8149d-f8b4-4442-a85d-d854c57993b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152847 Aug 08 17:25:26.647823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1229/2520] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:26 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:26.728919 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:26.729542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:26.735504 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.735982 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.736423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.737105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:26.737561 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:26.738014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:26.863934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:26.871960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-eb3f11d3-5db1-4765-bb0f-3424e1fd0131 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146751 Aug 08 17:25:26.872538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1292/2521] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:27.393672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:27.394314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:27.400225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.400711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.401149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:27.401853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.402311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.402736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:27.462772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:27.471167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:27.472656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:27.473853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64301ca0-6c3e-4aba-b5ec-05c76ffeff18 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084101 Aug 08 17:25:27.474402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1230/2522] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:27 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:27.670160 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:27.670867 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:27.678087 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.678679 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.679363 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:27.680079 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.680540 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.680973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:27.884267 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:27.892416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:27.892953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-cfb6b2ff-7ea5-431a-8c4a-c1a3f5edb712 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.228079 Aug 08 17:25:27.893081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:27.893464 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1293/2523] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:27.899442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.899921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.900350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:27.901038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:27.901482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:27.901925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:28.034595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:28.042434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c4c54017-ac87-4098-987b-f1342412c602 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153830 Aug 08 17:25:28.043221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1231/2524] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:28.496406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:28.497546 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:28.503748 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:28.504227 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:28.504661 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:28.505338 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:28.505814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:28.506235 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:28.565325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:28.573545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:28.575648 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:28.576774 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-66aa27bb-c9cc-4de4-af39-5ce30dc1be5b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084270 Aug 08 17:25:28.577325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1294/2525] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:28 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:28.914406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:28.914934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:28.921768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:28.922271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:28.922700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:28.923374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:28.923821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:28.924240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:29.049612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:29.057512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75462f70-86f4-4f73-b70f-87c705dc8cb9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146996 Aug 08 17:25:29.058091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1232/2526] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:28 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:29.064601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:29.065710 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:29.071630 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:29.072108 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:29.072538 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:29.073223 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:29.073683 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:29.074137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:29.206030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:29.213931 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2e72e855-be60-42b7-abbb-a371bb8c1198 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153036 Aug 08 17:25:29.214531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1295/2527] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:29.599304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:29.599945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:29.605921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:29.606407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:29.606847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:29.607528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:29.607984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:29.608412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:29.667915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:29.676100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:29.677602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:29.678831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a930bb03-6e35-4d28-8c5c-ff12cba82549 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.083493 Aug 08 17:25:29.679382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1233/2528] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:29 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:30.079797 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:30.080423 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:30.086849 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.087333 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.087771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.088460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.088923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.089351 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.215302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:30.223249 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d0b73556-d471-4c9d-b772-bec22c659f7c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147291 Aug 08 17:25:30.223810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1296/2529] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:30 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:30.235444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:30.236310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:30.242998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.243480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.243913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.244599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.245046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.245464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.375584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:30.379305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:30.384133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb088303-197e-4f5e-8822-4ac95ed761fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152499 Aug 08 17:25:30.384686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1234/2530] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:30.700387 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:30.701011 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:30.706934 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.707419 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.707883 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.708571 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:30.709029 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:30.709461 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:30.769705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:30.778530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:30.780040 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:30.781175 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-385a3d3c-86e3-41c3-82fc-b47c942c5c8a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084761 Aug 08 17:25:30.781950 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1297/2531] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:30 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:31.254051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:31.254665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:31.261579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.262596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.263036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.263715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.264181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.265027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.392046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:31.399928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b78292a9-daf5-461c-b596-b8d9e533fb68 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149991 Aug 08 17:25:31.400491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1235/2532] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:31 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:31.413695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:31.414347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:31.420843 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.421325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.421810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.422503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.422958 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.423383 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.554158 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:31.562549 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-39f89b0a-6436-4b8c-adff-00a42c886fff tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152663 Aug 08 17:25:31.563121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1298/2533] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:31.804545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:31.805097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:31.811165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.811650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.812118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.812809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:31.813267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:31.813692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:31.873893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:31.882402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:31.883907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:31.885051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ad9d3f2-d92a-4d1d-9acc-807a5290d57e tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.084456 Aug 08 17:25:31.885610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1236/2534] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:31 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:32.422429 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:32.422977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:32.429273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.429771 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.430277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.430988 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.431437 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.431858 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.558773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:32.566697 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-97d68522-1a62-4dab-a849-a48a745b4fe7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148757 Aug 08 17:25:32.567218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1299/2535] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:32.584556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:32.585168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:32.592454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.598092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.598092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.598092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.598092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.598472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.723842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:32.732262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bbbdecf5-550f-4350-8dc2-e3b860749bf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151559 Aug 08 17:25:32.732824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1237/2536] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:32.908317 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:32.908933 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:32.914861 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.915344 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.915804 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.916487 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:32.916944 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:32.917368 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:32.935739 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:32.982132 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:32.990356 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:32.991869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:32.993005 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a34bd058-c563-4e9b-8f23-ca70555f2039 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.088600 Aug 08 17:25:32.993560 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1300/2537] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:32 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:33.588304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:33.588961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:33.595619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:33.602390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:33.602390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:33.602390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:33.602390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:33.602788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:33.732878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:33.740779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-555f4323-b9ab-4202-94ee-aa668a1adedc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156545 Aug 08 17:25:33.741342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1238/2538] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:33 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:33.753003 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:33.753626 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:33.760027 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:33.760516 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:33.760959 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:33.761651 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:33.762146 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:33.762581 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:33.889089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:33.896965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b6f0704d-4477-4f38-978c-5b37848ba828 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148110 Aug 08 17:25:33.897531 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1301/2539] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:34.014889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:34.015496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:34.021569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.022119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.022611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:34.023323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.023781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.024208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:34.084951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:34.093992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:34.095440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:34.096577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c3bb596c-2de2-4942-9b6e-52b78f09c020 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.085603 Aug 08 17:25:34.097132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1239/2540] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:34 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:34.762711 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:34.763342 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:34.765663 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=80 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:34.770404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.770893 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.771337 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:34.772030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.772491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.772921 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:34.898670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:34.906442 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d5a9cbe9-2fc9-49d7-b433-c5afc183a01a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148253 Aug 08 17:25:34.907006 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1302/2541] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:34.919064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:34.919676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:34.926188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.926673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.927109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:34.927885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:34.928271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:34.928694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:35.057280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:35.066025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc2d73a1-e2f2-4823-8751-0d7f60ba596a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151179 Aug 08 17:25:35.066593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1240/2542] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:35.117471 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:35.118120 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:35.124610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:35.125092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:35.125535 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:35.126515 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:35.126977 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:35.127405 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:35.190182 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:35.198451 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:35.199953 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:35.201092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0cae89c3-c2e3-4c02-b048-3d8cd36072f5 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087432 Aug 08 17:25:35.201656 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1303/2543] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:35 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:35.928555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:35.929175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:35.935632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:35.936114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:35.936549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:35.937231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:35.937683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:35.938214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:36.062248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:36.070137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ffcc6c8-cabb-4dee-8440-404aa27e5d13 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145485 Aug 08 17:25:36.070701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1241/2544] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:35 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:36.086821 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:36.087438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:36.094403 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:36.094889 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:36.095325 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:36.096007 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:36.096468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:36.096895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:36.221470 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:36.223747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:36.224360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:36.229445 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-7403f064-a9d7-4c91-9408-932cc153b3a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146382 Aug 08 17:25:36.230051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1304/2545] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:36.231426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:36.231916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:36.232351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:36.233042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:36.233495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:36.233945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:36.295767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:36.304102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:36.305613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:36.306765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-32519417-ad18-40ae-8bcf-15f2d43e3a67 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086898 Aug 08 17:25:36.307313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1242/2546] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:36 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:37.091183 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:37.091836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:37.098316 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.098802 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.099270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.099964 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.100422 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.100860 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.241161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:37.249853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-a58f06fa-d28e-46ed-b74a-31d2eff157c7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.162653 Aug 08 17:25:37.250431 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1305/2547] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:37.252022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:37.252632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:37.258991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.259471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.259903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.260590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.261044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.261487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.494810 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:37.495438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:37.501636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.502157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.502603 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.503302 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:37.503803 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:37.504231 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:37.552664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:37.560744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e9bdb56-6815-45c2-9c42-8c9afbccf0f0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.312716 Aug 08 17:25:37.561247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1243/2548] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:37.621390 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:37.630200 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:37.631740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:37.632881 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-fb55c959-52a9-4ee7-b6b6-d793cad3d68b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.308051 Aug 08 17:25:37.633433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1306/2549] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:38.271150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:38.271772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:38.278268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.278754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.279197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.279882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.280338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.280766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.406238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:38.414072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-869aafc2-68d8-45a6-846d-1f239c4f5e1b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146944 Aug 08 17:25:38.414640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1244/2550] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:38.582112 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:38.582681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:38.589454 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.589967 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.590404 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.591089 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.591539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.591960 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.654915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:38.655545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:38.661396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.661905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.662340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.663021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:38.663471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:38.663890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:38.719483 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:38.727488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:38.727716 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9ad3343a-9c4a-4202-ae90-7a01acb020f3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149457 Aug 08 17:25:38.728386 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1307/2551] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:38.736355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:38.737854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:38.738974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c3db487b-b7ca-4595-9a03-9eba9c08e074 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.087905 Aug 08 17:25:38.739509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1245/2552] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:38 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:39.434121 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:39.434734 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:39.440740 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.441218 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.441699 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.442400 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.442853 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.443275 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.569075 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:39.577588 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-6642d22c-6163-446b-92d2-3ab0c3971bfd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147375 Aug 08 17:25:39.578256 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1308/2553] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:39.750084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:39.751025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:39.757426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.757939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.758382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.759121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.759608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.760032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.762548 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:39.763161 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:39.769364 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.769868 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.770304 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.771105 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:39.771568 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:39.771991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:39.840986 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:39.849537 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:39.851078 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:39.852222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-31328a16-3ddb-489f-a438-74f07b04e383 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.094192 Aug 08 17:25:39.853042 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1309/2554] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:39 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:39.900702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:39.908616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-181c707d-031b-42c2-8f38-c905826e1125 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.162859 Aug 08 17:25:39.909178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1246/2555] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:40.599592 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:40.600297 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:40.606923 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.607406 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.607842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.608530 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.608990 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.609416 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.736924 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:40.744913 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-473e8a46-0ced-423a-863a-5fbfdbbcacd7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149176 Aug 08 17:25:40.745670 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1310/2556] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:40 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:40.874394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:40.874933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:40.881634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.882165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.882602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.883285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.883737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.884164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.928991 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:40.929601 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:40.936000 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.936479 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.936909 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.937589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:40.938063 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:40.938491 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:40.944931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:40.953776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:40.955294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:40.956414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c3abe75-a03d-4a0d-9c92-0fe41516ed0c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 200 len: 1443 microversion: 2.20 time: 0.086004 Aug 08 17:25:40.956971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1247/2557] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:40 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:40.978960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18b70b11-e042-4b99-977c-5a16420a5403 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '.version_select at 0x7f7438765430>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:41.037265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18b70b11-e042-4b99-977c-5a16420a5403 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327296368" status: 204 len: 0 microversion: 2.20 time: 0.061918 Aug 08 17:25:41.037982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1248/2558] 10.222.0.57 () {60 vars in 1259 bytes} [Mon Aug 8 17:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327296368 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 17:25:41.094973 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:41.102719 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-9e0431ce-dc32-442d-82f4-fdccb805251b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.177691 Aug 08 17:25:41.103497 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1311/2559] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:41.767151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:41.767707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:41.773664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:41.774186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:41.774626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:41.775324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:41.775778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:41.776201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:41.987966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:41.997078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c36679c6-0b74-4734-a92c-1d0411ee3fa9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.233901 Aug 08 17:25:41.997652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1249/2560] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:42.123770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:42.124417 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:42.131315 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:42.131801 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:42.132424 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:42.133300 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:42.133666 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:42.134283 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:42.167602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e5b85f42-8ba1-49d6-a873-baf1a42f5dfb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'create', calling method: .version_select at 0x7f74387651f0>, body: {"keypair": {"name": "tempest-keypair-243339709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAK6aX9CmRIKEtuaJ5OT/+Jhk8Fa102j/lypBsYQdsR89zxXt2WUM1lQZieWNoHex5S96BacbX95KQnTiNa4LRChvNE0i+5FXFtPJMRxp3s4sjZWYl8erc9rfTItvkrKgA=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:25:42.187281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e5b85f42-8ba1-49d6-a873-baf1a42f5dfb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:25:42.191174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e5b85f42-8ba1-49d6-a873-baf1a42f5dfb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for user 60dc4976d686449f80d3bfad387a2406 and project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:25:42.268636 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:42.276518 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d1509751-33c8-4396-999f-6cedaaf8468d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.157182 Aug 08 17:25:42.277609 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1312/2561] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:42.281259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e5b85f42-8ba1-49d6-a873-baf1a42f5dfb tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.117478 Aug 08 17:25:42.282099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1250/2562] 10.222.0.57 () {62 vars in 1200 bytes} [Mon Aug 8 17:25:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 08 17:25:43.018234 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:43.018857 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:43.024792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:43.025270 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:43.025705 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:43.026415 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:43.026873 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:43.028045 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:43.164467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:43.169842 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-28969b1e-b40e-4cd3-bce4-3c806f8abd9b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155363 Aug 08 17:25:43.170421 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1313/2563] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:43.298368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:43.298985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:43.305403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:43.305910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:43.306344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:43.307022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:43.307475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:43.307894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:43.522626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:43.530870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce190e20-1c52-48e7-bbcb-3d0a1a038389 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.236383 Aug 08 17:25:43.531429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1251/2564] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:44.191076 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:44.191708 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:44.198179 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:44.198702 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:44.199137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:44.199833 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:44.200290 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:44.200722 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:44.336273 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:44.345048 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b4e43f5a-3cec-4144-b3ce-489b1c31f279 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.157920 Aug 08 17:25:44.345664 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1314/2565] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:44.471302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-332892754", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d971e3f8-836d-443a-bcd9-4128537cfc03"}], "security_groups": [{"name": "tempest-securitygroup--787522184"}], "key_name": "tempest-keypair-243339709", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:25:44.552197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:44.552813 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:44.559320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:44.560122 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:44.560564 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:44.561252 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:44.561709 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:44.562157 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:44.575464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] validate_networks() for [('d971e3f8-836d-443a-bcd9-4128537cfc03', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:25:44.695770 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:44.704379 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2be0d87c-e767-4d65-99aa-786cea0d1dee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.155967 Aug 08 17:25:44.704961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1315/2566] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:45.003043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:25:45.003527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:25:45.004155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:25:45.004624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:25:45.005045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:25:45.014774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.015260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.015698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.016421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.016875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.017302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.033716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:25:45.037684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Getting quotas for user 60dc4976d686449f80d3bfad387a2406 and project 3b8ed5fb092140a1a4e9ae005f3c8973. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:25:45.048569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:25:45.050816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:25:45.226389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c4180ae-a36d-470a-ae3d-981b2ce6b47a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.759320 Aug 08 17:25:45.227037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1252/2567] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Aug 8 17:25:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 17:25:45.237941 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:45.244051 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:45.300686 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:45.308251 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:45.310324 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:45.311428 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-8baff88c-9500-44f0-bf42-4dd0b9bcd42a tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1280 microversion: 2.20 time: 0.077480 Aug 08 17:25:45.311975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1316/2568] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:45 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:45.373737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:45.377541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:45.377541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:45.382675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.383163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.383595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.384317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.384765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.385183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.519755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:45.527730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ea94cece-4a3f-4bd6-aa37-8d81c4ea0f42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.159090 Aug 08 17:25:45.528301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1253/2569] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:45.726610 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:45.727308 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:45.734766 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.735814 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.739971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.739971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:45.739971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:45.739971 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:45.865496 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:45.873326 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-bc770b3c-8b24-4aeb-8064-69752518ddb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150601 Aug 08 17:25:45.873975 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1317/2570] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:46.333837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:46.334450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:46.341666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.342174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.342615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:46.343299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.343748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.344173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:46.348072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:46.408732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:46.416674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:46.418196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:46.419292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0b0c8597-f5b8-48a1-a338-7cd8892363af tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1284 microversion: 2.20 time: 0.089466 Aug 08 17:25:46.419857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1254/2571] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:46 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:46.549167 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:46.549725 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:46.556073 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.556557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.556994 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:46.557682 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.558676 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.559193 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:46.563545 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=100 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:46.701028 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:46.709070 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-b44db0d9-c123-4fde-8e4f-4ed03639d5c0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.164005 Aug 08 17:25:46.709635 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1318/2572] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:46 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:46.894819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:46.895349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:46.902332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.902806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.903236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:46.903912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:46.904360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:46.904778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:47.031919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:47.039910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-94d6ec71-8c84-46dd-b242-2e1fb007132a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149026 Aug 08 17:25:47.040464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1255/2573] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:47.441247 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:47.441879 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:47.448620 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:47.449092 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:47.449525 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:47.450230 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:47.450681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:47.451101 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:47.543262 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:47.551369 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:47.552871 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:47.554053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-d57a4866-3ebf-44a3-ac9b-70bc521c62aa tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1340 microversion: 2.20 time: 0.116687 Aug 08 17:25:47.559055 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1319/2574] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:47 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:25:47.730022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:47.730637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:47.737082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:47.737558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:47.738022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:47.738709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:47.739158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:47.739578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:47.877336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:47.885345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30067e84-033c-4fa5-8789-dd80076c2e44 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.159159 Aug 08 17:25:47.886707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1256/2575] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:47 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:48.061634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:48.062395 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:48.068347 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.068836 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.069276 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:48.070008 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.070467 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.070895 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:48.231072 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:48.239014 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-0a75226d-5cb9-4111-b18f-217c969e7138 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.181830 Aug 08 17:25:48.239574 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1320/2576] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:48.577715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:48.578393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:48.584994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.585487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.586189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:48.586840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.587402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.587826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:48.720064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:48.728045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:48.729581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:48.730728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27d18c01-e520-4e7b-969e-8ac9dddd01d1 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.157728 Aug 08 17:25:48.731276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1257/2577] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:48 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:48.907907 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:48.908503 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:48.915222 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.915717 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.916137 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:48.916832 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:48.917277 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:48.917869 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.088639 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.policy [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130500) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:49.096773 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO nova.api.openstack.requestlog [None req-2482af8c-d444-4f72-a6cd-e53ffb9c5c67 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.193241 Aug 08 17:25:49.097542 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: [pid: 130500|app: 0|req: 1321/2578] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:48 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:49.216589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6937642-f6c9-415f-b140-119e5cd7a1c1", "tag": "2b9bb0ed-3ad7-47f3-840e-3b728f626fce"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:25:49.225881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:49.226362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:49.226793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.238162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] Creating event network-changed:2b9bb0ed-3ad7-47f3-840e-3b728f626fce for instance b6937642-f6c9-415f-b140-119e5cd7a1c1 on hv-cinder-85221 Aug 08 17:25:49.242896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-824a207e-f82b-4da5-8c46-3de9c7ac2c7b req-ab765ff6-9b81-416a-b01f-de30c810846e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105743 Aug 08 17:25:49.243796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1258/2579] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:25:49.260720 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.api.openstack.wsgi [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:49.261367 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG nova.compute.api [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130500) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:49.267539 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:49.268053 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:49.268488 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.269185 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:49.269638 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:49.270093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG oslo_concurrency.lockutils [None req-9e81587d-ec3e-44ca-9722-e789fee0317e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.465939 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:25:49.467241 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:25:49.489295 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Traceback (most recent call last): Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: timer() Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: cb(*args, **kw) Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: waiter.switch() Aug 08 17:25:49.489450 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: greenlet.error: cannot switch to a different thread Aug 08 17:25:49.753486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:49.754224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:49.760330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:49.760813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:49.761254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.761970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:49.762426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:49.762850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:49.894236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:49.902653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:49.904154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:49.905282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-870e86bb-30b6-413d-a6ac-556b505ca28c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.156272 Aug 08 17:25:49.905848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1259/2580] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:49 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:50.122165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:50.122777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:50.128923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:50.129399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:50.129862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:50.130544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:50.130995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:50.131418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:50.260456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:50.268830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92c8d247-3bff-4f65-a1d4-d0d93b646278 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150361 Aug 08 17:25:50.269391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1260/2581] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:50.927932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:50.928568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:50.935279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:50.935846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:50.936271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:50.936953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:50.937398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:50.937839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:51.071912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:51.079984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:51.081495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:51.082631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27f77a96-5281-4ba0-927d-f6e28b342e9c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.158671 Aug 08 17:25:51.083192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1261/2582] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:50 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:51.290060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:51.290881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:51.297985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:51.298473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:51.298910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:51.299609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:51.300062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:51.300487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:51.430249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:51.438524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2232f4f3-9ed4-4469-8b53-2af83a233e16 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152408 Aug 08 17:25:51.439103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1262/2583] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:25:52.104765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:52.105429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:52.111291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:52.111769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:52.112203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:52.112871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:52.113318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:52.113737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:52.241751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:52.250614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:52.252129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:52.253224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d612571b-e749-471f-83ae-a88746074972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.152318 Aug 08 17:25:52.253776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1263/2584] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:52 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:52.459756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:52.460295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:52.466869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:52.467351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:52.467786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:52.468546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:52.469003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:52.469428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:52.604102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:52.612515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b06f8f94-c206-44e0-8b2e-de37d1e03e86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156720 Aug 08 17:25:52.613066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1264/2585] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:53.275671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:53.276337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:53.282796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:53.283271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:53.283701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:53.284376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:53.284825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:53.285245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:53.415556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:53.423275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:53.424775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:53.425889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21b2a9d0-87c9-4dbd-be51-516255496219 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.154068 Aug 08 17:25:53.426433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1265/2586] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:53 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:53.634352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:53.634963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:53.641996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:53.642559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:53.642987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:53.643662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:53.644108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:53.644605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:53.773526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:53.781602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-26321e55-8aba-4bd4-8e2b-3036ee9070f1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151201 Aug 08 17:25:53.782197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1266/2587] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:53 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:54.446868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:54.447582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:54.453541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:54.454065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:54.454508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:54.455203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:54.455669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:54.456095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:54.589600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:54.598075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:54.599574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:54.600679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dfacbb00-490e-485a-a59f-bb560211fea6 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.157786 Aug 08 17:25:54.601233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1267/2588] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:54 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:54.801145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:54.801757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:54.808158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:54.808632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:54.809064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:54.809764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:54.810239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:54.810664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:54.935779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:54.943624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-765997d0-5cd1-4693-8ac5-a0c5bbeea0a4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146126 Aug 08 17:25:54.944184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1268/2589] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:54 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:55.304510 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell0:SELECT=2 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:55.624387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:55.625303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:55.627299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:55.627952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=10 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:55.632792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:55.633276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:55.633712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:55.634429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:55.634886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:55.635322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:55.769442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:55.777466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:55.782526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:55.782526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5cee29a9-639b-48b1-a75a-878ee9302537 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.160735 Aug 08 17:25:55.782526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1269/2590] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:55 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:55.964979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:55.966225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:55.972681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:55.973166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:55.973608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:55.974305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:55.974760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:55.975183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:56.110207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:56.120662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ea559ae5-5671-4c9a-8d6d-cddb5b9951e4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156987 Aug 08 17:25:56.120662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1270/2591] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:55 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:56.176276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6937642-f6c9-415f-b140-119e5cd7a1c1", "name": "network-vif-plugged", "status": "completed", "tag": "2b9bb0ed-3ad7-47f3-840e-3b728f626fce"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:25:56.185616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:56.186133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:56.186566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:56.197032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] Creating event network-vif-plugged:2b9bb0ed-3ad7-47f3-840e-3b728f626fce for instance b6937642-f6c9-415f-b140-119e5cd7a1c1 on hv-cinder-85221 Aug 08 17:25:56.202600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-1db9540c-dea1-4e08-96ac-168740253dec req-74188629-01a9-4236-ba64-13170722d10c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082882 Aug 08 17:25:56.203191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1271/2592] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:25:56.803858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:56.804555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:56.811208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:56.811757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:56.812130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:56.812816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:56.813267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:56.813695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:56.817963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:56.948372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:56.956290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:56.957833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:56.958943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-771e64ee-e88f-4366-ac08-3266d13ae58d tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.159300 Aug 08 17:25:56.959497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1272/2593] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:56 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:57.139411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:57.139940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:57.146223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:57.146698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:57.147122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:57.147819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:57.148270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:57.148687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:57.295338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:57.304640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27211f64-922c-4bad-ab9f-b8ba50234551 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.168882 Aug 08 17:25:57.305201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1273/2594] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:57.980919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:57.981524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:57.987432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:57.987911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:57.988346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:57.989032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:57.989486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:57.989942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:58.118672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:58.127499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:58.128982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:58.130086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-47ef3919-08c1-4c3b-9883-62f5244086d8 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1405 microversion: 2.20 time: 0.153013 Aug 08 17:25:58.130638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1274/2595] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:57 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:58.325219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:58.325864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:58.332945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:58.333760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:58.334085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:58.334837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:58.335573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:58.336007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:58.469401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:58.477915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-df424956-c06b-4c10-b2e9-dead439ff606 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.157104 Aug 08 17:25:58.478477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1275/2596] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:25:59.152372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:59.153639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:59.159452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.159932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.160363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.161036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.161484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.161935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.264695 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_api:SELECT=43 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:59.288634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:59.289114 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: DEBUG dbcounter [-] [130500] Writing DB stats nova_cell1:SELECT=26 {{(pid=130500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:25:59.296579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:59.298091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:59.302400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92675629-f180-444c-8bf8-8fd85064606b tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1596 microversion: 2.20 time: 0.150774 Aug 08 17:25:59.302400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1276/2597] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:25:59 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1596 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:25:59.320823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:59.321316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:59.327746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.328228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.328664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.329348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.329817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.330247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.407367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-891b822e-78fa-486a-8314-7b08f660972c tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090260 Aug 08 17:25:59.407998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1277/2598] 10.222.0.57 () {60 vars in 1316 bytes} [Mon Aug 8 17:25:59 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:25:59.499882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:25:59.500590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:25:59.506635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.507115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.507555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.508237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:25:59.508697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:25:59.509126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:25:59.736532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:25:59.744408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-151c3355-8a8c-4ff1-bca8-760e76565321 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.248648 Aug 08 17:25:59.745026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1278/2599] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:25:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:00.513843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6937642-f6c9-415f-b140-119e5cd7a1c1", "tag": "2b9bb0ed-3ad7-47f3-840e-3b728f626fce"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:26:00.523258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:00.523738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:00.524170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:00.535803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] Creating event network-changed:2b9bb0ed-3ad7-47f3-840e-3b728f626fce for instance b6937642-f6c9-415f-b140-119e5cd7a1c1 on hv-cinder-85221 Aug 08 17:26:00.541054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-25cab152-c394-4abe-872d-863cddb84817 req-247ff669-275c-47bc-9f0b-30d0c8185320 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086173 Aug 08 17:26:00.541680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1279/2600] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:26:00.767826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:00.768973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:00.775442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:00.776043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:00.776578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:00.777526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:00.778687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:00.779191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:00.920760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:00.929058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77af0187-747e-4e4f-85cd-c30c668c8473 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.165682 Aug 08 17:26:00.929639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1280/2601] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:01.950913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:01.951541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:01.957916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:01.958403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:01.958839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:01.959527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:01.959984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:01.960413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:02.089133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:02.097336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b18a4e5-522f-4c2a-a771-65e4b4fea22c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150943 Aug 08 17:26:02.098115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1281/2602] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:03.117855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:03.118502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:03.125872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:03.126357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:03.126796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:03.127474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:03.127924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:03.128342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:03.490287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:03.498059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-917efb72-7bbd-4a0d-909f-1e9774166150 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.384017 Aug 08 17:26:03.498620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1282/2603] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:03 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:04.519109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:04.525319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:04.526110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:04.526592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:04.527031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:04.527714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:04.528167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:04.528592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:04.656332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:04.664231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-790ae1c1-a9c1-41b9-803e-a178ee6eb7dc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149029 Aug 08 17:26:04.664779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1283/2604] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:05.685636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:05.686269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:05.692711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:05.693188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:05.693625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:05.694332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:05.694785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:05.695213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:05.823037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:05.830894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8c8134d4-a034-468c-829a-792bcd45e307 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149239 Aug 08 17:26:05.831454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1284/2605] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:06.851710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:06.852330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:06.859177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:06.859663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:06.860098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:06.860779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:06.861232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:06.861656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:06.986836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:06.994687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-412cc8a1-8979-4978-9547-8da7100b3d92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146892 Aug 08 17:26:06.995248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1285/2606] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:08.017263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:08.018025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:08.031153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:08.031614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:08.032046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:08.032730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:08.033180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:08.033597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:08.163902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:08.172262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2c0dcd52-0b40-4f12-928d-2c88a9f7663f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.158813 Aug 08 17:26:08.172824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1286/2607] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:09.193578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:09.194280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:09.201088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:09.201568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:09.202033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:09.202716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:09.203167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:09.203590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:09.330161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:09.338139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-22f91aa1-1fa4-4d7e-b7f1-ac4770610197 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148313 Aug 08 17:26:09.338713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1287/2608] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:09 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:10.359171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:10.359810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:10.366231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:10.366707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:10.367137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:10.367817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:10.368264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:10.368681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:10.494731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:10.502830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1bab2bdf-4534-4762-a58a-34a9f1e85d04 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148068 Aug 08 17:26:10.503397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1288/2609] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:10 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:11.524436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:11.525047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:11.531920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:11.532397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:11.532834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:11.533514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:11.533992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:11.534414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:11.666422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:11.670523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:11.675200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11f08c4e-8bbb-44fe-b375-c0586c54569b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154637 Aug 08 17:26:11.675800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1289/2610] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:12.701434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:12.702324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:12.709049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:12.709528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:12.710002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:12.710684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:12.711135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:12.711555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:12.836697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:12.846056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b346c0b0-eb3e-4ba6-9209-f3689f37d131 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151281 Aug 08 17:26:12.846611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1290/2611] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:13.866657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:13.867274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:13.873685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:13.874457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:13.874892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:13.875570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:13.876029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:13.876449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:14.005053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:14.012906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ddb5c0a-c92d-48f7-9c71-e61e7d7694c2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150071 Aug 08 17:26:14.013463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1291/2612] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:15.033760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:15.034415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:15.040499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:15.040976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:15.041408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:15.042114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:15.042566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:15.042988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:15.179047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:15.179047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-60d9a890-732e-4ad4-9282-f3fc34236d8f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147485 Aug 08 17:26:15.179047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1292/2613] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:16.198024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:16.198693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:16.205423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:16.205940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:16.206378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:16.207062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:16.207515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:16.207937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:16.332664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:16.340568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-103b3a44-e442-4cfe-9e18-95973b73dafa tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146378 Aug 08 17:26:16.341137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1293/2614] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:16 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:17.361434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:17.362184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:17.364435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=82 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:17.369074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:17.369551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:17.370021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:17.370735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:17.371187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:17.372520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:17.505040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:17.513516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59ab2206-6780-4e58-b52e-82e578711136 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155858 Aug 08 17:26:17.514121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1294/2615] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:17 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:18.534574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:18.535238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:18.541525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:18.542043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:18.542478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:18.543154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:18.544186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:18.544606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:18.674064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:18.681819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a4690d3d-dfb8-4770-b19c-7d131bc6b2bb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151038 Aug 08 17:26:18.682372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1295/2616] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:19.702563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:19.703196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:19.709526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:19.710036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:19.710467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:19.711137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:19.711588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:19.712010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:19.844190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:19.851934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e43dd665-bb43-43c6-b3cd-4e93753eb2b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153238 Aug 08 17:26:19.852493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1296/2617] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:19 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:20.874028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:20.874727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:20.880996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:20.887985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:20.887985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:20.887985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:20.887985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:20.888457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:21.011165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:21.019059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd538b55-99f9-4851-98ac-9c0d0fb3458f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149810 Aug 08 17:26:21.019617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1297/2618] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:22.039190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:22.039790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:22.046278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:22.050922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:22.050922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:22.050922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:22.050922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:22.051301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:22.178880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:22.187333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fad66464-260e-40c0-8a61-64813fee751f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151972 Aug 08 17:26:22.187893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1298/2619] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:22 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:23.208131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:23.208903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:23.215818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:23.216301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:23.216731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:23.217408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:23.217892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:23.218311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:23.345142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:23.353040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-151a7be1-84a2-45f7-9921-9df14403ad20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148789 Aug 08 17:26:23.353606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1299/2620] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:23 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:24.374261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:24.374853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:24.381187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:24.381664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:24.382136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:24.382813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:24.383259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:24.383679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:24.508903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:24.516701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c39539a2-c569-4cba-b6f9-0c70468cab6b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146594 Aug 08 17:26:24.517401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1300/2621] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:24 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:25.537427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:25.538180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:25.544644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:25.545124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:25.545557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:25.546273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:25.546725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:25.547149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:25.677180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:25.685082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-39a65f04-130b-475d-9f2b-c5386c993bf6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151505 Aug 08 17:26:25.685639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1301/2622] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:26.705973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:26.706536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:26.712919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:26.713399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:26.713859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:26.714543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:26.715571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:26.716047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:26.845038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:26.852987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5313a5ca-ddbc-4d49-a79f-ca701005c2b7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151022 Aug 08 17:26:26.857732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1302/2623] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:26 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:27.875171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:27.875816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:27.882076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:27.882557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:27.882991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:27.883668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:27.884122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:27.884546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:28.013655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:28.021628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d2e4c1a-56dd-4ffb-b01b-84107b953239 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151278 Aug 08 17:26:28.022225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1303/2624] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:29.043739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:29.044412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:29.050830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:29.051312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:29.051756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:29.052445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:29.052899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:29.053325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:29.182973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:29.191604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6de81e0d-9920-42dc-9104-0a42e26e6072 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151756 Aug 08 17:26:29.192170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1304/2625] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:29 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:30.212257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:30.212891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:30.219844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:30.220357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:30.220789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:30.221466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:30.221948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:30.222369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:30.349708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:30.357658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bf01f6f4-522a-42af-93e8-cc6340aa2862 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149407 Aug 08 17:26:30.358246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1305/2626] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:30 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:31.379223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:31.379851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:31.386170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:31.387134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:31.387564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:31.388237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:31.388682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:31.389099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:31.407024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:31.518874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:31.526664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76fadf66-8108-4315-afd0-522d7ef92075 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151273 Aug 08 17:26:31.527802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1306/2627] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:31 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:32.548559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:32.549238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:32.555495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:32.555970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:32.556400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:32.557076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:32.557523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:32.557974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:32.687868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:32.695908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bda933be-b217-4be8-be95-15726962f22a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151171 Aug 08 17:26:32.696507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1307/2628] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:33.716805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:33.717484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:33.723790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:33.724273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:33.724708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:33.725394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:33.725897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:33.726330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:33.855979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:33.864160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f9ac967-b1f4-4c61-8d09-de8721a36043 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151254 Aug 08 17:26:33.864736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1308/2629] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:33 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:34.885019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:34.885655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:34.892010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:34.892486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:34.892926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:34.893605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:34.894082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:34.894506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:35.022562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:35.030930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e125652-6ace-4c62-accc-b5fc5d2648b5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149719 Aug 08 17:26:35.031486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1309/2630] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:36.052268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:36.052941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:36.059770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:36.060243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:36.060732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:36.061409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:36.061883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:36.062331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:36.196301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:36.204297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d7fa9c6-4f30-4010-9b40-5ee79edab595 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155906 Aug 08 17:26:36.212915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1310/2631] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:36 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:36.564487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:36.564980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:36.570865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:36.571343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:36.571775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:36.572451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:36.572897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:36.573315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:36.596230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5c6efe53-5da4-4bc5-8093-1c648f3aa551 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1/ips" status: 200 len: 150 microversion: 2.20 time: 0.035596 Aug 08 17:26:36.596803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1311/2632] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Aug 8 17:26:36 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:26:37.225540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:37.226239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:37.232712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:37.233195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:37.233634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:37.234363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:37.234818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:37.235243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:37.361780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:37.369680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9bc12673-a4d4-4bf6-9383-490afef9d399 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147960 Aug 08 17:26:37.370270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1312/2633] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:38.391689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:38.392300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:38.398673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:38.399146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:38.399578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:38.400250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:38.400697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:38.401111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:38.526696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:38.534621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-292f9ff5-6b5c-4644-8fa9-8a43325f4b54 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146733 Aug 08 17:26:38.535181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1313/2634] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:39.556161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:39.556800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:39.563226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:39.563750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:39.564191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:39.564883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:39.565340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:39.565767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:39.695170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:39.703437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d02d916-91c5-46be-b275-2d5828781c6c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151162 Aug 08 17:26:39.704035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1314/2635] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:40.724704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:40.725355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:40.731709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:40.732187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:40.732618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:40.733290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:40.733736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:40.734177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:40.862143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:40.870062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-29bca84f-e5f4-476d-81b8-a320188ced20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149216 Aug 08 17:26:40.871232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1315/2636] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:40 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:41.891644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:41.892279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:41.898859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:41.899344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:41.899775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:41.900456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:41.900903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:41.901330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:42.032887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:42.040696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aab7d8ac-156d-42ce-ad06-141ac725fb1e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153030 Aug 08 17:26:42.041245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1316/2637] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:43.061499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:43.062268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:43.068506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:43.068976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:43.069404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:43.070263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:43.070967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:43.071392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:43.205596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:43.213480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f55c402f-1833-4a06-bdbe-8eb04e70d0f2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155808 Aug 08 17:26:43.214578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1317/2638] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:44.234913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:44.235719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:44.241897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:44.242375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:44.242808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:44.243485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:44.243935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:44.244355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:44.368891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:44.377075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7f5c3d3-957a-43b2-8bb6-e23777928ae6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145978 Aug 08 17:26:44.377627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1318/2639] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:45.398415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:45.399125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:45.405769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:45.406271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:45.406697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:45.407375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:45.407823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:45.408241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:45.538212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:45.546779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35743efe-37a3-4582-988e-6af72ec491b1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152200 Aug 08 17:26:45.547336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1319/2640] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:46.567651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:46.568296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:46.574462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:46.574945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:46.575380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:46.576059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:46.576512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:46.576937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:46.703122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:46.710915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1ecdaf5-c828-454c-9a70-52605ea64c20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147133 Aug 08 17:26:46.711465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1320/2641] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:46 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:47.731608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:47.733657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:47.738245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=54 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:47.743917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:47.744400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:47.744838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:47.745526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:47.746010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:47.746430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:47.878501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:47.886263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd9d74b5-917f-43cc-8fff-c7e7eeefda26 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.158559 Aug 08 17:26:47.886818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1321/2642] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:47 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:48.907594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:48.908257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:48.914760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:48.915243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:48.915687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:48.916404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:48.916859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:48.917285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:49.041999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:49.049860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77947e42-25c5-47a7-8cd4-80baf4fa28a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146085 Aug 08 17:26:49.050428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1322/2643] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:48 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:49.318889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:49.319502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:49.326130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:49.326618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:49.327060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:49.327747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:49.328203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:49.328630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:49.350996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:49.463210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:49.471219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c36aeca-c6d3-47d7-9a3d-2f759e5d31f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.156151 Aug 08 17:26:49.471787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1323/2644] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:50.071408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:50.072045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:50.078527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:50.079009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:50.079443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:50.080128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:50.080584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:50.081044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:50.208141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:50.216661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0fe5cf37-2fc6-48d5-a401-f453e677d273 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149044 Aug 08 17:26:50.217218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1324/2645] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:50.492488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:50.493107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:50.500113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:50.500597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:50.501037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:50.501720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:50.502203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:50.502631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:50.632162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:50.640745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9edd1f5f-b33f-43e9-913b-9e488ad7c97b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152124 Aug 08 17:26:50.641302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1325/2646] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:51.237123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:51.237816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:51.244097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:51.244576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:51.245618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:51.246322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:51.246773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:51.247192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:51.380640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:51.388538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e5f4a55-4bc9-4586-a0be-fe685b91ded2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155212 Aug 08 17:26:51.389089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1326/2647] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:51.662677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:51.663291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:51.669262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:51.669745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:51.670212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:51.670895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:51.671349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:51.671788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:51.797079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:51.805075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b5199231-295e-4d16-8d95-388efd308306 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146317 Aug 08 17:26:51.805635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1327/2648] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:52.409812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:52.410462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:52.416991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:52.417501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:52.417976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:52.418660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:52.419115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:52.419539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:52.550782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:52.558719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6536e9df-aa32-4ffb-9262-f3366e90294d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152809 Aug 08 17:26:52.559289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1328/2649] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:52.827009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:52.827552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:52.833462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:52.833990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:52.834430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:52.835114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:52.835566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:52.835991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:52.961228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:52.969126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11f00e2f-2743-49e2-a157-420105b306d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146645 Aug 08 17:26:52.969697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1329/2650] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:53.579669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:53.580334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:53.586728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:53.587216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:53.587684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:53.588873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:53.589348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:53.589777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:53.716209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:53.724205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41da8df5-286c-4d37-8adf-1d73a87db39d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148417 Aug 08 17:26:53.727748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1330/2651] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:53 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:53.989572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:53.990217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:53.996353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:53.996834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:53.997524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:53.998254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:53.998710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:53.999134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:54.132596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:54.141062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18785c5c-b5fe-4b66-937c-c292ea1eac93 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.155287 Aug 08 17:26:54.141630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1331/2652] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:54.746656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:54.747581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:54.753903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:54.754386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:54.754822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:54.755504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:54.755953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:54.756375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:54.881944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:54.889690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f412993-b957-418f-add7-ebe9f959b48e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147472 Aug 08 17:26:54.890275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1332/2653] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:54 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:55.162582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:55.163112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:55.169501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:55.170008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:55.170440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:55.171110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:55.171565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:55.171979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:55.302600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:55.310404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f5a3105a-510a-4a29-98f8-1df06f6edc6b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151591 Aug 08 17:26:55.310961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1333/2654] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:55.910624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:55.911226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:55.917601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:55.918114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:55.918552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:55.919242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:55.919691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:55.920120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:56.045958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:56.054296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aedce549-ea36-417f-b922-ece2c2fbc735 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147572 Aug 08 17:26:56.054889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1334/2655] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:55 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:56.331293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:56.331904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:56.337858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:56.338344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:56.338781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:56.339458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:56.339915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:56.340371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:56.468011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:56.475743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f5f5c0c8-aae0-4d80-ad6c-5c9c764b0982 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148242 Aug 08 17:26:56.476299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1335/2656] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:57.076174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:57.076815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:57.083320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:57.083825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:57.084260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:57.084973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:57.085428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:57.085885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:57.212101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:57.220570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99b939df-17ec-44da-a67f-20e8782574d9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148727 Aug 08 17:26:57.221144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1336/2657] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:57.498055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:57.498671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:57.504555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:57.505039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:57.505479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:57.506195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:57.506650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:57.507074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:57.636368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:57.642251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9fdbae37-7661-4cfb-9192-b07b95f2b788 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148722 Aug 08 17:26:57.642835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1337/2658] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:58.240399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:58.241064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:58.248312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:58.248794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:58.249232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:58.249948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:58.250429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:58.250860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:58.381683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:58.389592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2cd9936-b159-4067-97f0-9c53fcdb1cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153039 Aug 08 17:26:58.390181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1338/2659] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:58.663356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:58.663983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:58.670467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:58.670958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:58.671400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:58.672088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:58.672544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:58.672976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:58.816474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:58.824378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2488ced-90b0-4bc6-8259-66c305d5a510 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.164871 Aug 08 17:26:58.824950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1339/2660] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:59.410143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:59.410846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:59.417098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:59.417579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:59.418049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:59.418735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:59.419187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:59.419610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:59.423448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:26:59.551124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:59.559567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fd83837c-3f8e-4868-8a59-67199454fdcb tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153425 Aug 08 17:26:59.560130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1340/2661] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:26:59.845524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:26:59.846160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:26:59.853337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:59.854425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:59.854966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:59.855656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:26:59.856100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:26:59.856518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:26:59.982510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:26:59.990476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-14b84c79-ef1a-4c39-b492-70b95acb4cd7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148838 Aug 08 17:26:59.991040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1341/2662] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:26:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:00.581111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:00.581748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:00.588187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:00.589040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:00.589161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:00.590493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:00.590946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:00.591367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:00.717630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:00.725518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1d1bab09-0bdd-4484-9579-a939f01478e3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148184 Aug 08 17:27:00.731830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1342/2663] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:01.012883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:01.013502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:01.019469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:01.019970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:01.020410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:01.021099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:01.021589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:01.022053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:01.151048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:01.158988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fff36b01-4f12-4be1-afcb-1a35eb133611 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150655 Aug 08 17:27:01.159580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1343/2664] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:01.586489 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:27:01.587030 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:27:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:27:01.746318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:01.747201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:01.753516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:01.754022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:01.754455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:01.755127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:01.755575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:01.756014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:01.880917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:01.888863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0743e9d7-2334-45ad-abf0-55faf0804f71 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146294 Aug 08 17:27:01.889425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1344/2665] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:02.179254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:02.179765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:02.186058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:02.186542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:02.186984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:02.187674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:02.188127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:02.188566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:02.318179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:02.326626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5518000-4720-40cf-bf98-3d696a58e61e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151345 Aug 08 17:27:02.327190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1345/2666] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:02.910182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:02.910820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:02.917177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:02.918183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:02.918624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:02.919311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:02.919768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:02.920197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:03.047498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:03.055447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cae1bf45-3234-4e7e-abb7-204fd51c6268 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149289 Aug 08 17:27:03.056012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1346/2667] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:02 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:03.347696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:03.348314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:03.354185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:03.354670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:03.355127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:03.355817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:03.356274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:03.356700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:03.487124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:03.494965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccc9eda1-31f9-4132-b04a-2d68fdfb12e9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151084 Aug 08 17:27:03.495525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1347/2668] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:04.077247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:04.077926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:04.084461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:04.084950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:04.085391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:04.086110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:04.086570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:04.087001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:04.214277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:04.222326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-56b055d1-83a7-4002-9a88-9a778eacce06 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149448 Aug 08 17:27:04.222959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1348/2669] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:04.516442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:04.517050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:04.522981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:04.526590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:04.526590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:04.526590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:04.526590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:04.527004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:04.653223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:04.661097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b23bd5b1-ee66-4b78-802f-af07d2f8cced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148514 Aug 08 17:27:04.661651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1349/2670] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:05.242339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:05.243025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:05.250203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:05.250711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:05.251143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:05.251828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:05.252273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:05.252693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:05.387953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:05.390718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38ebdfbb-3ecd-4b17-aa50-b50d53d1db3b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152148 Aug 08 17:27:05.391289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1350/2671] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:05.445473 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:27:05.446046 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:27:05.682542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:05.683157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:05.689063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:05.689536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:05.690011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:05.690689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:05.691135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:05.691551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:05.818149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:05.826527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7adfe675-1214-4087-8668-4e3253041a2d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147803 Aug 08 17:27:05.827087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1351/2672] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:06.414227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:06.419151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:06.425524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:06.426038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:06.426472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:06.427145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:06.427592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:06.428010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:06.559037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:06.567032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf30c2f9-edc4-4461-a095-9a21350930ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.159101 Aug 08 17:27:06.567601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1352/2673] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:06.848094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:06.848709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:06.855109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:06.855604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:06.856039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:06.856721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:06.857178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:06.857598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:06.985478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:06.993564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2e6d298e-afa7-46d9-b126-a264da4ce8d8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149312 Aug 08 17:27:06.994160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1353/2674] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:07.589961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:07.590575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:07.596995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:07.597472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:07.597928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:07.598735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:07.599174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:07.599591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:07.724189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:07.731983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bbf13ef2-a8f6-473e-ab53-b1820adf7014 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146478 Aug 08 17:27:07.732542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1354/2675] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:07 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:08.015466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:08.016104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:08.021841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:08.022319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:08.022750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:08.023419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:08.023861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:08.024275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:08.154797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:08.162760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2f48ba3f-832f-4073-81d8-16c07cd7a080 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151541 Aug 08 17:27:08.163320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1355/2676] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:08.752844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:08.753483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:08.759952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:08.760432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:08.760867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:08.761546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:08.762025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:08.762452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:08.887562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:08.890922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:08.895624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a8a8dd41-23d1-4f83-bc05-12afb25c237c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146684 Aug 08 17:27:08.896179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1356/2677] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:09.184716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:09.185256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:09.192016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:09.192504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:09.192944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:09.193645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:09.194119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:09.194545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:09.322811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:09.331474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-452ca55f-9e3b-4178-8f60-1a583bd38904 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150896 Aug 08 17:27:09.332047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1357/2678] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:09.916280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:09.917495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:09.923876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:09.924348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:09.924776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:09.925451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:09.925924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:09.926351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:10.052935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:10.061150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b09a0319-1940-4bb1-9553-0725a3460690 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148786 Aug 08 17:27:10.061704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1358/2679] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:09 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:10.352227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:10.352847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:10.358873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:10.359352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:10.359786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:10.360458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:10.360933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:10.361352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:10.491100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:10.499260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-55e7f026-1b23-45d6-b919-01c18553dede tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150809 Aug 08 17:27:10.499822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1359/2680] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:11.081142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:11.081839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:11.088173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:11.088645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:11.089689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:11.090390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:11.090840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:11.091258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:11.216902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:11.224964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6c973d69-ed13-4796-b4ab-644170bd0e6a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147616 Aug 08 17:27:11.225522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1360/2681] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:11.520841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:11.521447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:11.529147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:11.529625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:11.530087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:11.530766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:11.531211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:11.531659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:11.656696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:11.664505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18f68566-023b-4bf3-ae83-6aa2a68f562d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147426 Aug 08 17:27:11.665072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1361/2682] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:12.246101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:12.247031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:12.253830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:12.254317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:12.254751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:12.255442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:12.255895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:12.256321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:12.388286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:12.396184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-676f60c3-29e2-42a1-9769-52f766bf39f0 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154142 Aug 08 17:27:12.396686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1362/2683] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:12.685820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:12.686374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:12.692309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:12.692791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:12.693230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:12.693953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:12.694414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:12.694840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:12.965133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:12.972945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa761717-4819-475b-a1f4-31edcbf21718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.291166 Aug 08 17:27:12.973500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1363/2684] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:13.417902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:13.418545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:13.424768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:13.425245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:13.425674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:13.426375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:13.426825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:13.427244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:13.555941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:13.564718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11a69f8f-f956-480f-bd35-5c555ed8a4a2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151102 Aug 08 17:27:13.565283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1364/2685] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:13.994041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:13.994649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:14.000721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:14.001196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:14.001632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:14.002336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:14.002783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:14.003202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:14.129305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:14.137670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f13f2aed-2c12-4b63-a9d3-729aa2672876 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147383 Aug 08 17:27:14.144708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1365/2686] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:14.585404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:14.586102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:14.592503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:14.592989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:14.593426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:14.594157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:14.594613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:14.595039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:14.720554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:14.728328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0238c7e-cde5-47e8-ab1c-b900f90b44fd tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146853 Aug 08 17:27:14.728879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1366/2687] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:15.158552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:15.159169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:15.164960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:15.165440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:15.165911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:15.166599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:15.167556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:15.167978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:15.296522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:15.304282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2cd5781a-8689-4cc1-bf77-21ed3f624dab tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149527 Aug 08 17:27:15.304827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1367/2688] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:15.748899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:15.749516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:15.755931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:15.756417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:15.756855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:15.757544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:15.758039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:15.758473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:15.882794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:15.891114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-694b0ec7-df8c-4d2b-a2e1-a407fde067f4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146399 Aug 08 17:27:15.891670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1368/2689] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:16.324998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:16.325608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:16.331457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:16.331931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:16.332357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:16.333032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:16.333557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:16.334007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:16.466145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:16.474191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccebc089-1aac-42c2-8164-4a6cce98b354 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.153654 Aug 08 17:27:16.474758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1369/2690] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:16.911952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:16.912573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:16.918482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:16.918992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:16.919428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:16.920116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:16.920571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:16.920998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:17.045929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:17.053883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f78f2864-add8-402c-9ebc-2cbe715b6cb8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145849 Aug 08 17:27:17.054443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1370/2691] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:16 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:17.500661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:17.501279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:17.503638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:17.508297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:17.508783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:17.509228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:17.509953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:17.510415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:17.510843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:17.641329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:17.649294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d757135-b302-46da-af9f-6d1dbe7f096d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152787 Aug 08 17:27:17.649859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1371/2692] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:18.075738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:18.076383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:18.082343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:18.082823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:18.083260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:18.083943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:18.084400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:18.084826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:18.218388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:18.226140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5c1527a1-0431-4bf0-9a03-9aa5d1f2ea7e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154713 Aug 08 17:27:18.226708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1372/2693] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:18.674116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:18.674677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:18.680973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:18.681464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:18.681922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:18.683243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:18.683692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:18.684113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:18.701508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:18.810685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:18.818480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-334b2a47-7d78-4341-8e3f-42988a7f3b1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149273 Aug 08 17:27:18.819033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1373/2694] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:19.247237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:19.247928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:19.253739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:19.254244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:19.254674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:19.255349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:19.255798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:19.256214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:19.383978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:19.392354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7fd6ba0-3c40-4d3d-89a2-a9adaf2b9c7d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149319 Aug 08 17:27:19.392910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1374/2695] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:19 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:19.840166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:19.840709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:19.847074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:19.847552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:19.847988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:19.848667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:19.849120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:19.849546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:19.974253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:19.982088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6649fc2b-7cab-4593-8e53-8e5f22ede712 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145844 Aug 08 17:27:19.982647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1375/2696] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:20.414035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:20.414655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:20.421409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:20.421927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:20.422366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:20.423055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:20.423511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:20.423935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:20.554214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:20.562168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03c54a6c-640c-434b-ad4c-77557315b72b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152116 Aug 08 17:27:20.562726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1376/2697] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:21.003496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:21.004110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:21.010581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:21.011062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:21.012000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:21.012680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:21.013133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:21.013587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:21.141575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:21.149371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9ccc86e-27de-4e51-8d2c-8b53de36bfd0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149711 Aug 08 17:27:21.149950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1377/2698] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:21.585932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:21.586672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:21.593533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:21.593882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:21.594505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:21.595209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:21.595662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:21.596090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:21.730569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:21.738725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ab089ad2-2f3b-45fa-a051-fc9c4b4bd38c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.156668 Aug 08 17:27:21.739394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1378/2699] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:21 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:22.170961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:22.171588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:22.177930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:22.178416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:22.178861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:22.179555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:22.180047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:22.180481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:22.311320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:22.319241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2a5e244-34e6-49a7-9a63-0b5c928a36d4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152837 Aug 08 17:27:22.319808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1379/2700] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:22.760504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:22.761176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:22.767584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:22.768063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:22.768497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:22.769186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:22.769636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:22.770104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:22.894234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:22.902094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-22b00156-161d-4327-8188-17e9ba4cd8c8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.145403 Aug 08 17:27:22.902655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1380/2701] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:22 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:23.340282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:23.340919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:23.347351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:23.347836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:23.348276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:23.348966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:23.349428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:23.349880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:23.479171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:23.487602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f35c709c-e77b-4183-848b-567bd355d4fd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151117 Aug 08 17:27:23.488165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1381/2702] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:23.923132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:23.923765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:23.929732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:23.930249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:23.930691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:23.931380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:23.931840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:23.932270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:24.058247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:24.066085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-86c157f0-5319-44c7-ad66-16ef71fb38ab tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146839 Aug 08 17:27:24.066646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1382/2703] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:23 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:24.509158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:24.509825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:24.517589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:24.518150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:24.518636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:24.519382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:24.519846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:24.520278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:24.654406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:24.662203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49564d14-bcae-48db-9f3b-d26516394c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.157136 Aug 08 17:27:24.662756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1383/2704] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:25.087442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:25.088090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:25.093960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:25.094439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:25.094897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:25.095571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:25.096040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:25.096443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:25.219955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:25.227720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0b2f8ac-4408-4a4c-96c4-0e66ffe5776c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.144123 Aug 08 17:27:25.228281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1384/2705] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:25.684693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:25.685308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:25.691682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:25.692160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:25.692594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:25.693271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:25.693734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:25.694164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:25.827124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:25.835148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ded836b0-985a-4d86-8d57-e808daad03fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.155030 Aug 08 17:27:25.835721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1385/2706] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:26.248579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:26.249279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:26.255084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:26.255571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:26.256004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:26.256686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:26.257139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:26.257563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:26.386713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:26.394444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a0398fb5-9fda-4175-b366-03d06ab3783d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149912 Aug 08 17:27:26.395018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1386/2707] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:26 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:26.857193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:26.857730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:26.864180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:26.864661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:26.865104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:26.865813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:26.866315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:26.866739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:26.992423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:27.000871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81bec21d-bc90-4022-9572-a9d9cbdc77a9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148185 Aug 08 17:27:27.001430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1387/2708] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:27.415822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:27.416488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:27.422899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:27.423393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:27.423826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:27.424501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:27.424946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:27.425368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:27.552742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:27.560607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44c0dced-59f1-451f-bd04-e1caa5322c86 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148615 Aug 08 17:27:27.561173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1388/2709] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:28.021964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:28.022608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:28.029036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:28.029522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:28.029992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:28.030682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:28.031141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:28.031570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:28.155851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:28.163637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-26e5ec52-7bc7-4213-a015-bb2388f42585 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145570 Aug 08 17:27:28.164199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1389/2710] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:28.581458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:28.582130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:28.588218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:28.588694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:28.589135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:28.589889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:28.590345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:28.590772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:28.594925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:28.716605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:28.724385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7031fab2-6ac8-47bc-bf22-49aea5c79a9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146721 Aug 08 17:27:28.724937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1390/2711] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:28 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:29.185089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:29.185692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:29.192191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:29.192674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:29.193111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:29.193846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:29.194257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:29.194678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:29.322911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:29.330699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb9b3b09-90b1-47dd-ac78-bcdb6fddbc6d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150129 Aug 08 17:27:29.331255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1391/2712] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:29.746314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:29.746951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:29.752800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:29.753282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:29.753711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:29.754412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:29.754880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:29.755285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:29.884295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:29.892612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc792639-c7ef-4a5f-9073-c516b5870bd5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150498 Aug 08 17:27:29.893168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1392/2713] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:29 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:30.351658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:30.352266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:30.358546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:30.359019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:30.359448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:30.360123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:30.360589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:30.360991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:30.491155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:30.499838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-525494f1-3d85-471c-8446-1c6f4d0b1a1f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152093 Aug 08 17:27:30.500400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1393/2714] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:30.914872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:30.915504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:30.921928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:30.925969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:30.925969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:30.925969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:30.925969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:30.926424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:31.051024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:31.058949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3637a225-a57e-42cf-b851-d504b2604b9c tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148034 Aug 08 17:27:31.059506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1394/2715] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:30 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:31.521563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:31.522129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:31.529084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:31.529564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:31.530049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:31.530732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:31.531187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:31.531613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:31.660367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:31.668297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b85f52f8-cedc-4499-b7c7-7dc25e64468c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150609 Aug 08 17:27:31.668870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1395/2716] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:32.080122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:32.080848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:32.086943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:32.087421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:32.088943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:32.090341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:32.091146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:32.091917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:32.450054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:32.457942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0e4ceda4-1c46-4ca5-b514-799e9f980dc2 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.381667 Aug 08 17:27:32.458501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1396/2717] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:32.688996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:32.689619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:32.695984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:32.696471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:32.696912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:32.697603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:32.698083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:32.698513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:32.826041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:32.833841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ee8947b5-49f1-4166-9889-9ec64c5fbd98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148758 Aug 08 17:27:32.834397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1397/2718] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:33.478926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:33.479631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:33.485616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:33.486198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:33.486640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:33.487337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:33.487793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:33.488223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:33.616823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:33.625582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f93174fa-172a-40ca-8680-193952417ec6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150614 Aug 08 17:27:33.626189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1398/2719] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:33 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:33.855543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:33.856695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:33.863067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:33.863551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:33.864018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:33.864707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:33.865163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:33.865590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:33.991469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:34.000089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e96b987-20f2-4d2f-99dc-fe3330a5eb08 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148446 Aug 08 17:27:34.000646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1399/2720] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:34.646584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:34.647173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:34.653551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:34.654066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:34.654508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:34.655196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:34.655655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:34.656085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:34.785114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:34.792916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a23e5193-fcd1-4fd0-8989-bbc8e135ab42 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150305 Aug 08 17:27:34.793524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1400/2721] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:35.021678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:35.022342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:35.029263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:35.029745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:35.030399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:35.031088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:35.031544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:35.031970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:35.155955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:35.163831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3a38adbc-29a7-4b41-a63a-cf2c4674c1a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145925 Aug 08 17:27:35.164394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1401/2722] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:35.815387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:35.816037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:35.821940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:35.822420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:35.822854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:35.823532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:35.823981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:35.824401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:35.952386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:35.960255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1edf4ef5-78ff-416d-923f-4bda5f688571 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148690 Aug 08 17:27:35.960802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1402/2723] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:35 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:36.184564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:36.185130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:36.191371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.191849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.192282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.192960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.193410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.193854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.327010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:36.328144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-733f309c-8695-45a9-9108-b33ee4e814d2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147342 Aug 08 17:27:36.328708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1403/2724] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:36.671094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:36.671604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:36.677592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.678117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.678563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.679283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.679742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.680171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.704417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:27:36.970478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db568e88-c69a-4876-ae32-47c2af2f1e38 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 204 len: 0 microversion: 2.20 time: 0.302953 Aug 08 17:27:36.971127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1404/2725] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Aug 8 17:27:36 2022] DELETE /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 17:27:36.979608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:36.980303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:36.986056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.986540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.987074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.987758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:36.988215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:36.988643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:36.992839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:37.125978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:37.133827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:37.135329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:37.136482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64aab411-4f0c-4924-b4b2-968713ae3df0 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1720 microversion: 2.20 time: 0.161016 Aug 08 17:27:37.149807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1405/2726] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:36 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:27:37.149807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:37.149807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:37.149807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:37.150278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:37.150278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:37.150278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:37.150278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:37.150678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:37.278228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:37.286231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5837f5c9-71fb-460a-a67b-af0665158efe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147580 Aug 08 17:27:37.286788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1406/2727] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:37 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:37.349000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:37.349603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:37.355363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:37.356357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:37.356792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:37.357485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:37.357977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:37.358406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:37.484886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:37.492698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4501f3a4-bd04-415d-8b26-ff9181d07d3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147338 Aug 08 17:27:37.493259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1407/2728] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:38.160571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:38.161253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:38.167183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.167665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.168102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.168788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.169244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.169670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.297533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:38.305605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:38.307178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:38.308342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00ab8ffd-d174-40be-b5e8-6a197535ceba tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1720 microversion: 2.20 time: 0.151733 Aug 08 17:27:38.308894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1408/2729] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:38 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:27:38.313163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:38.313767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:38.319570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.320053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.320486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.321180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.321633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.322079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.450254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:38.458094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e8d5ee68-8f2f-4d21-982f-d56c9e370916 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148245 Aug 08 17:27:38.458657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1409/2730] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:38 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:38.515709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:38.516368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:38.522161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.522636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.523080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.523735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:38.524180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:38.524598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:38.651590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:38.659488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b2f877c-af9e-44be-8752-73b40a94e3f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148165 Aug 08 17:27:38.660051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1410/2731] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:39.331070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:39.331693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:39.338574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.344782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.344782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.344782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.344782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.345176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.477756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:39.486355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:39.487867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:39.489054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0999950-d000-4148-bfb1-07b2ca785972 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1720 microversion: 2.20 time: 0.162056 Aug 08 17:27:39.489613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1411/2732] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:39 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:27:39.613685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:39.614342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:39.620186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.626448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.626448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.626448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.626448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.626814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.755269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:39.763954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-87ebae83-1bab-44d4-b754-3f7abbc8ad99 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.273354 Aug 08 17:27:39.764530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1412/2733] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:39 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:39.768887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:39.769487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:39.775422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.775901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.776335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.777018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.777493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.778542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.923125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:39.932316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b7ebf127-92d4-4df5-990b-801e40081279 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.166767 Aug 08 17:27:39.940924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1413/2734] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:39.946052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6937642-f6c9-415f-b140-119e5cd7a1c1", "name": "network-vif-deleted", "tag": "2b9bb0ed-3ad7-47f3-840e-3b728f626fce"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:27:39.957476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:39.958064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:39.958755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:39.971262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] Creating event network-vif-deleted:2b9bb0ed-3ad7-47f3-840e-3b728f626fce for instance b6937642-f6c9-415f-b140-119e5cd7a1c1 on hv-cinder-85221 Aug 08 17:27:39.976968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-7ffff47c-6978-4069-a42a-87eb17861d2a req-3ee55751-bf46-4085-a219-444d3ab114cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034156 Aug 08 17:27:39.977583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1414/2735] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:27:40.512755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:40.516856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:40.520219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.520804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.521313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.522274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.522732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.523165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.561317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.561835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.562328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.562782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lazy-loading 'fault' on Instance uuid b6937642-f6c9-415f-b140-119e5cd7a1c1 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:27:40.612553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:40.644119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:40.645645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dc4976d686449f80d3bfad387a2406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8ed5fb092140a1a4e9ae005f3c8973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:40.646867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2615db83-9731-4d27-8e11-459606ab8c97 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 200 len: 1370 microversion: 2.20 time: 0.138487 Aug 08 17:27:40.647432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1415/2736] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:40 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 1370 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:27:40.784649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:40.785261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:40.791346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.791823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.792257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.792937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.793416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.793988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.932827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:40.940781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6089c48-e84c-46f0-987a-719a4d275dd3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.160111 Aug 08 17:27:40.941336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1416/2737] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:40 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:40.954397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:40.955217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:40.957280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:40.968004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.969820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.969820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:40.969820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:40.970217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:40.970563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:41.107173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:41.115094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-055a3690-9b85-4d6c-b5b5-56fd5b9035a0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.164454 Aug 08 17:27:41.115655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1417/2738] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:41.670612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:41.671226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:41.677536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:41.678056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:41.678489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:41.679172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:41.679626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:41.680048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:41.693587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] HTTP exception thrown: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Request method failure captured: Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 HTTP/1.1 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEklXc14OY0-E2ExT5BHrA68F7OOToFPfZVM_3KFwr0icJg8pDQ02uiDcJvrSjqOzqhJtxkgnSsPPTkefbnUkX7Eb0nGRJZqA_jkpRrcuggVR3_XCImNUmI8xC8X52G4Wrd7j5OFbXL0KgI442Lcv7u0WKSgCfnJBJoy_-ZjPy_GEg Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:27:41.695247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3b8ed5fb092140a1a4e9ae005f3c8973", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 60dc4976d686449f80d3bfad387a2406 Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:41.697101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'b6937642-f6c9-415f-b140-119e5cd7a1c1'} Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:27:41.698208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:41.700482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:41.702007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Returning 404 to user: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:27:41.702007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad7772cb-591c-4040-aec1-1115a7f8d05f tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 404 len: 111 microversion: 2.20 time: 0.030293 Aug 08 17:27:41.702007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1418/2739] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:41 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 17:27:41.705219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0bfc4812-90c1-4191-b359-a971685d15e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '.version_select at 0x7f7438768940>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:41.810554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0bfc4812-90c1-4191-b359-a971685d15e4 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243339709" status: 204 len: 0 microversion: 2.20 time: 0.108671 Aug 08 17:27:41.811093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1419/2740] 10.222.0.57 () {60 vars in 1259 bytes} [Mon Aug 8 17:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243339709 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 17:27:41.961946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:41.962562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:41.969309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:41.969805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:41.970256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:41.970942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:41.971399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:41.971824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.129564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:42.142427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-67f60c3f-4f1b-479c-b4b8-ce9fca42e8e9 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.184323 Aug 08 17:27:42.153323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1420/2741] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:41 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:42.158395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:42.159119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:42.165053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.165539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.166013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.166701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.167153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.167576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.307236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:42.315737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-48d0694a-d733-416c-8c01-9fe3eaad2f50 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.161280 Aug 08 17:27:42.316406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1421/2742] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:42.530837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:42.533815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:42.537434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.537954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.538394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.539124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.539580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.540005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.553253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] HTTP exception thrown: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Request method failure captured: Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 HTTP/1.1 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEklXc14OY0-E2ExT5BHrA68F7OOToFPfZVM_3KFwr0icJg8pDQ02uiDcJvrSjqOzqhJtxkgnSsPPTkefbnUkX7Eb0nGRJZqA_jkpRrcuggVR3_XCImNUmI8xC8X52G4Wrd7j5OFbXL0KgI442Lcv7u0WKSgCfnJBJoy_-ZjPy_GEg Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:27:42.554828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3b8ed5fb092140a1a4e9ae005f3c8973", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 60dc4976d686449f80d3bfad387a2406 Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.556729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'b6937642-f6c9-415f-b140-119e5cd7a1c1'} Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:27:42.557607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.559075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.560522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Returning 404 to user: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:27:42.560522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd0339ed-7129-41c5-960c-81924f994a08 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 404 len: 111 microversion: 2.20 time: 0.029945 Aug 08 17:27:42.560522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1422/2743] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Aug 8 17:27:42 2022] DELETE /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:27:42.564557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:42.565157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: b6937642-f6c9-415f-b140-119e5cd7a1c1] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:42.570850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.571326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.571759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.572436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:42.572888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:42.573312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:42.586775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] HTTP exception thrown: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Request method failure captured: Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 HTTP/1.1 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEklXc14OY0-E2ExT5BHrA68F7OOToFPfZVM_3KFwr0icJg8pDQ02uiDcJvrSjqOzqhJtxkgnSsPPTkefbnUkX7Eb0nGRJZqA_jkpRrcuggVR3_XCImNUmI8xC8X52G4Wrd7j5OFbXL0KgI442Lcv7u0WKSgCfnJBJoy_-ZjPy_GEg Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:27:42.588327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3b8ed5fb092140a1a4e9ae005f3c8973", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 60dc4976d686449f80d3bfad387a2406 Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.590081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'b6937642-f6c9-415f-b140-119e5cd7a1c1'} Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:27:42.592112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. Aug 08 17:27:42.593460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:27:42.594692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Returning 404 to user: Instance b6937642-f6c9-415f-b140-119e5cd7a1c1 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:27:42.594692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e1a7975a-3ed2-4327-a603-3b2a2516c1b9 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1" status: 404 len: 111 microversion: 2.20 time: 0.028622 Aug 08 17:27:42.594692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1423/2744] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:27:42 2022] GET /compute/v2.1/servers/b6937642-f6c9-415f-b140-119e5cd7a1c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:27:43.165279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:43.165974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:43.173074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:43.173554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:43.174028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:43.174714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:43.175168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:43.175624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:43.304095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:43.312571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc45e739-4e11-47c0-9a1f-51cd1daa32bf tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151131 Aug 08 17:27:43.313124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1424/2745] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:43 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:43.337034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:43.337641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:43.343171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:43.343654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:43.344091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:43.344771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:43.345228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:43.345655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:43.349495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:43.471122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:43.478969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38746703-8ddc-4c76-8829-7365fdf65b5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145390 Aug 08 17:27:43.479521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1425/2746] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:44.332569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:44.333244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:44.339650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:44.340130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:44.340565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:44.341249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:44.341702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:44.342164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:44.475148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:44.483833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3aff702-5043-4ee6-a80a-e692049360d7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.155165 Aug 08 17:27:44.484398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1426/2747] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:44 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:44.500220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:44.500825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:44.506583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:44.507062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:44.507498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:44.508174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:44.508622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:44.509041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:44.638952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:44.646980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e0628f1-539e-4a0f-a887-f663cfdf5ef2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150323 Aug 08 17:27:44.647537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1427/2748] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:45.504428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:45.505263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:45.511514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:45.511996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:45.512912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:45.513605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:45.514088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:45.514516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:45.642968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:45.650950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-891b342e-35aa-4c22-ac5f-03982671eff5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150375 Aug 08 17:27:45.651515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1428/2749] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:45 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:45.668196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:45.669355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:45.674996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:45.675469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:45.675899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:45.676575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:45.677022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:45.677442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:45.806001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:45.813721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dd0d4a19-c882-4b04-ab2e-87862cf8ad6f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149022 Aug 08 17:27:45.814302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1429/2750] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:46.672670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:46.673303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:46.679189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:46.679669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:46.680111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:46.680793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:46.681247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:46.681672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:46.813366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:46.821271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8fbbb303-00f5-45e1-8e6c-0f82b4e4c713 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153347 Aug 08 17:27:46.821844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1430/2751] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:46 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:46.834629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:46.835242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:46.840953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:46.841435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:46.841918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:46.842605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:46.843063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:46.843495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:46.974082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:46.982514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb509856-fb7a-4bed-bf70-cf84d2439cd9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151436 Aug 08 17:27:46.983078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1431/2752] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:47.842725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:47.843358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:47.849768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:47.850276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:47.850713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:47.851401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:47.851855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:47.852277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:47.979291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:47.987147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-43313423-dccf-4d13-930c-43e190abc405 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148268 Aug 08 17:27:47.987703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1432/2753] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:47 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:48.003627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:48.004230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:48.009781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:48.010286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:48.010718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:48.011400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:48.011847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:48.012266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:48.141199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:48.149041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59f9d7d1-49aa-409a-8a84-184c53d207c2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148861 Aug 08 17:27:48.149602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1433/2754] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:49.008429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:49.009056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:49.016185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:49.016671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:49.017135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:49.017844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:49.018306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:49.018736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:49.165355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:49.173407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-17fccc76-f0cb-4981-a853-d60cc4c57b92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.168806 Aug 08 17:27:49.173991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1434/2755] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:49 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:49.178418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:49.179023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:49.184989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:49.185471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:49.185939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:49.186630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:49.187086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:49.187515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:49.314738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:49.322565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aeeffdb4-f708-472a-ae19-07ba97e9e107 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147647 Aug 08 17:27:49.323129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1435/2756] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:50.193960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:50.194629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:50.201667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:50.202184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:50.202616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:50.203293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:50.203739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:50.204161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:50.333153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:50.341604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-43c04f8f-cda0-46b8-8ce9-e1aa364b5bc8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151543 Aug 08 17:27:50.342196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1436/2757] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:50 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:50.346441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:50.347042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:50.352472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:50.352948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:50.353378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:50.354073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:50.354520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:50.354937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:50.480984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:50.488747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a76fc4b7-4b91-4cfb-a9ae-11700e9b7324 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145646 Aug 08 17:27:50.502375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1437/2758] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:51.362586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:51.363216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:51.370129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:51.370613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:51.371054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:51.372250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:51.372705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:51.373128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:51.499553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:51.507390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f0366820-3f37-4b6d-bdbb-673d555f9821 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148748 Aug 08 17:27:51.507944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1438/2759] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:51 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:51.521459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:51.522097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:51.527643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:51.528123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:51.528671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:51.529357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:51.529829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:51.530257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:51.659598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:51.667472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e5105ef8-8716-4cf2-8c4b-be0916b40730 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149566 Aug 08 17:27:51.668044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1439/2760] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:52.528409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:52.529126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:52.536216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:52.536699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:52.537138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:52.537860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:52.538340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:52.538772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:52.665701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:52.675912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8bd39ff3-7492-4a41-b9cc-f09cb1e97ff8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151509 Aug 08 17:27:52.676477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1440/2761] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:52 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:52.688586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:52.689225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:52.695127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:52.695607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:52.696039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:52.696724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:52.697191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:52.697599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:52.828479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:52.831892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:27:52.836610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-20b67cdc-e17b-4760-8f2e-42c9f1c9e12c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152224 Aug 08 17:27:52.837168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1441/2762] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:53.698119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:53.698756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:53.706181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:53.706658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:53.707090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:53.707764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:53.708212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:53.708632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:53.835609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:53.844090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd7ca8d4-eed5-441d-a7d1-226e6b847463 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149832 Aug 08 17:27:53.844587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1442/2763] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:53 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:53.856986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:53.858044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:53.863711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:53.864269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:53.864704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:53.865381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:53.865859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:53.866283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:53.996176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:54.004126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b5a461d6-4847-454b-a926-c6a8454e8214 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150718 Aug 08 17:27:54.004685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1443/2764] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:54.864742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:54.865357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:54.872003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:54.872981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:54.873411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:54.874124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:54.874574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:54.874991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:55.004120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:55.012612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4969c8e8-2158-4c1a-92b0-9ae2ff9c03e8 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151701 Aug 08 17:27:55.013723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1444/2765] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:54 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:55.023950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:55.024552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:55.030134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:55.030610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:55.031037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:55.031711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:55.032159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:55.032580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:55.159785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:55.167829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7a9e84f-258e-4486-9104-ae0b7e81c45b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147298 Aug 08 17:27:55.168431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1445/2766] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:56.034680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:56.035373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:56.041724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:56.042244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:56.042685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:56.043373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:56.043832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:56.044265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:56.172354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:56.180194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d1000889-a70b-48af-a38e-a005a0e9840b tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149413 Aug 08 17:27:56.180759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1446/2767] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:56 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:56.187704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:56.188314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:56.193953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:56.194435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:56.194869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:56.195551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:56.196009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:56.196435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:56.321203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:56.329568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ddaed8b4-98d1-4e60-8f15-2c4934ad5c87 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145468 Aug 08 17:27:56.330162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1447/2768] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:57.201097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:57.201728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:57.208057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:57.208544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:57.208979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:57.209661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:57.210399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:57.210826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:57.339353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:57.347646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4082440e-ff41-4ac2-bc74-18d7a729a6d3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150531 Aug 08 17:27:57.348205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1448/2769] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:57 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:57.352486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:57.353089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:57.359182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:57.359663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:57.360100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:57.360780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:57.361235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:57.361658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:57.488500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:57.496665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-359858c5-2b6e-46e3-896e-f9d61510fc2c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147518 Aug 08 17:27:57.497222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1449/2770] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:58.368383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:58.369077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:58.375711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:58.376191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:58.376634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:58.377317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:58.377768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:58.378211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:58.502923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:58.510755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-87d1a5d5-4cbd-4f6e-8bc3-7b8bebe9d61a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146203 Aug 08 17:27:58.511673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1450/2771] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:58 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:58.517510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:58.518294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:58.523973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:58.524454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:58.524887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:58.525567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:58.526047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:58.526468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:58.656860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:58.664824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1a3dacfd-cbee-42a6-bee4-553e9e9f7115 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151291 Aug 08 17:27:58.665397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1451/2772] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:27:59.532788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:59.533485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:59.540139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:59.545836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:59.545836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:59.545836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:59.545836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:59.546251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:59.673146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:59.680952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8fa18aa6-2ec8-4012-b842-9be96aef113d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152490 Aug 08 17:27:59.688614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1452/2773] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:59 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:27:59.688614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:27:59.688614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:27:59.692168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:59.692643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:59.693079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:59.693752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:27:59.694243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:27:59.694661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:27:59.825869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:27:59.834134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-251f016a-bf0e-49f8-9682-ff0bcfad1987 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151626 Aug 08 17:27:59.834693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1453/2774] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:27:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:00.701708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:00.702366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:00.708827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:00.709314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:00.709776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:00.710499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:00.710953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:00.711413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:00.838971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:00.847274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f52d29b5-5549-4ff3-a5f7-6951520ffb19 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149623 Aug 08 17:28:00.847829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1454/2775] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:00 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:00.855380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:00.856042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:00.862406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:00.862889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:00.863329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:00.864012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:00.864460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:00.864887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:00.993729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:01.001939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5e3dfb3e-2083-467c-b15c-437fe1e16434 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150144 Aug 08 17:28:01.002503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1455/2776] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:00 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:01.868750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:01.869611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:01.876425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:01.876902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:01.877333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:01.878041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:01.878490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:01.878913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:02.005337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:02.013062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ecc23a2-4055-4721-8f5a-5b2258aef0bc tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148187 Aug 08 17:28:02.013614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1456/2777] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:01 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:02.022632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:02.023238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:02.028751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:02.029230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:02.029708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:02.030429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:02.030881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:02.031305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:02.157715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:02.165674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-422abc16-972c-494c-8c35-5052ee8005dd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146547 Aug 08 17:28:02.166318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1457/2778] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:03.034331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:03.034953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:03.041388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:03.041905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:03.042622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:03.043322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:03.043778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:03.044206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:03.063942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:03.176100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:03.184081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b14ee677-16d0-4791-b39e-94f5406bfa14 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.154282 Aug 08 17:28:03.184636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1458/2779] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:03 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:03.189589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:03.190227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:03.195773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:03.196255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:03.196689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:03.197378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:03.197850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:03.198279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:03.323053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:03.332743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-50aa401f-a86c-49c3-b565-a2494d4bb16f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147108 Aug 08 17:28:03.333303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1459/2780] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:04.204833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:04.205522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:04.211809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:04.212283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:04.212712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:04.213386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:04.213856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:04.214278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:04.343573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:04.352018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-867c0aab-b14e-46ce-ab48-63b3ad87cffe tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151001 Aug 08 17:28:04.352578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1460/2781] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:04 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:04.356862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:04.357459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:04.363404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:04.363877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:04.364309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:04.365016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:04.365446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:04.365939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:04.492993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:04.502059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b4f4896-bea6-4d6d-aafe-02c2f82154f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148496 Aug 08 17:28:04.502874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1461/2782] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:05.377169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:05.378206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:05.384481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:05.393411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:05.393411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:05.393411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:05.393411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:05.393882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:05.518121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:05.526077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2748be5b-55ef-4a5f-9209-a9e4fb165083 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153417 Aug 08 17:28:05.526634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1462/2783] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:05 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:05.531692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:05.532276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:05.537906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:05.538385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:05.538818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:05.539494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:05.539971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:05.540399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:05.671608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:05.679386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6b720a6-9c46-4fd6-b8d5-6e725a53285b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.151182 Aug 08 17:28:05.679945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1463/2784] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:06.546898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:06.547510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:06.553848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:06.554332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:06.554766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:06.555440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:06.555890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:06.556306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:06.683776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:06.691646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7fcb643a-9d47-4547-b1eb-73285bf90c3d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148660 Aug 08 17:28:06.695625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1464/2785] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:06 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:06.701035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:06.701636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:06.707687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:06.708170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:06.708607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:06.709289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:06.709741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:06.710199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:06.838263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:06.846055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db83928a-1dba-44b0-b058-c1bc6e81a8a1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148461 Aug 08 17:28:06.846612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1465/2786] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:07.715207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:07.715772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:07.718092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:07.723163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:07.723640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:07.724072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:07.724747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:07.725193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:07.725612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:07.852881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:07.861372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a5a5e3c4-8736-472d-a9f0-fddd78200b6e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150099 Aug 08 17:28:07.861957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1466/2787] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:07 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:07.866755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:07.867363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:07.873211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:07.873693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:07.874158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:07.874927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:07.875385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:07.875810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:08.004363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:08.012203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a8b0e8e3-79f4-4043-b46e-0e4f682bd7f1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148939 Aug 08 17:28:08.012766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1467/2788] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:07 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:08.882252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:08.882881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:08.889355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:08.889872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:08.890845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:08.891542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:08.892003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:08.892435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:09.018042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:09.025838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4eb31d9d-d2a1-4438-9d59-dae9cbb9c15e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147439 Aug 08 17:28:09.026403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1468/2789] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:08 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:09.033881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:09.034498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:09.040153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:09.040636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:09.041076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:09.041764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:09.042268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:09.042699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:09.167124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:09.175092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-166a435c-24d5-4dc9-818c-1d2e17277d70 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145376 Aug 08 17:28:09.177286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1469/2790] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:10.047883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:10.048567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:10.054867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:10.055343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:10.055778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:10.056453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:10.056905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:10.057326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:10.187101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:10.194958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2a1b2a0-e360-44d8-81b7-a6a16e0dc32a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.151571 Aug 08 17:28:10.195522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1470/2791] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:10 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:10.199794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:10.200395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:10.206300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:10.206780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:10.207213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:10.207891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:10.208340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:10.208761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:10.332415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:10.340138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-341ce9a3-68bf-4732-9ceb-10c50494b4c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.143704 Aug 08 17:28:10.340695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1471/2792] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:11.216319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:11.217018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:11.223503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:11.223993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:11.224434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:11.225127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:11.225585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:11.226043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:11.357142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:11.365697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12c4e96e-b9eb-4bfe-86a8-6b12313fb165 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.153284 Aug 08 17:28:11.366287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1472/2793] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:11 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:11.370927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:11.371528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:11.377256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:11.377746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:11.378220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:11.378911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:11.379373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:11.379799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:11.505949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:11.513773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f6d7125-c530-43e2-bab9-0e37aa4c8f45 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146561 Aug 08 17:28:11.514360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1473/2794] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:12.386722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:12.387365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:12.394337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:12.394818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:12.395249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:12.395925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:12.396574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:12.396849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:12.522699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:12.530561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0313d2cf-f62c-4ec5-a512-7d5f12abcf70 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147699 Aug 08 17:28:12.531123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1474/2795] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:12 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:12.535422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:12.536025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:12.541564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:12.542079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:12.542515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:12.543198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:12.543654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:12.544078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:12.548480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:12.675099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:12.683014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b314105-88b2-492d-a06b-468c335aa287 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150971 Aug 08 17:28:12.683571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1475/2796] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:13.551333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:13.552013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:13.558326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:13.558804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:13.559260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:13.559931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:13.560379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:13.560796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:13.688152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:13.695889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-79e146a5-6fa3-4c69-bc3c-892f97df0c2f tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148509 Aug 08 17:28:13.696443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1476/2797] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:13 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:13.704594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:13.705207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:13.710880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:13.711367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:13.711808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:13.712494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:13.712953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:13.713382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:13.841509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:13.849416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4de705a0-a7aa-4c01-a05a-cd8dba0f1135 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149001 Aug 08 17:28:13.850009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1477/2798] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:14.717670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:14.718303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:14.725372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:14.725888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:14.726332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:14.727021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:14.727474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:14.727903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:14.852391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:14.860137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4adea11f-aac3-442e-a76c-cdbdc79f013e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.146314 Aug 08 17:28:14.860732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1478/2799] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:14 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:14.870503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:14.871117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:14.876794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:14.877286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:14.877728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:14.878445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:14.878903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:14.879331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:15.006728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:15.014588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-634df380-60c8-4410-a61f-bf5462e681d3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147932 Aug 08 17:28:15.015155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1479/2800] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:15.880570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:15.881176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:15.887636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:15.888121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:15.888563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:15.889248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:15.889703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:15.890154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:16.017911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:16.025820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2eac32e-b1b9-407c-8b58-b1a7d4cd4ef4 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.149179 Aug 08 17:28:16.026371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1480/2801] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:15 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:16.036272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:16.036877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:16.042400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:16.042885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:16.043325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:16.044012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:16.044469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:16.044899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:16.169806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:16.177918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-735b7862-cbca-43ec-89da-5e6ede3908fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145053 Aug 08 17:28:16.178483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1481/2802] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:17.047529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:17.048209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:17.054128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:17.054611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:17.055050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:17.055742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:17.056204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:17.056633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:17.184987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:17.193584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4184ce19-0d4e-41dd-957a-cf548fc70f05 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150418 Aug 08 17:28:17.194177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1482/2803] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:17 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:17.198645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:17.199251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:17.204706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:17.205192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:17.205633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:17.206348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:17.206809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:17.207244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:17.331584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:17.339498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0569d42f-f350-4c4b-bbff-fa044de8f7d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.144346 Aug 08 17:28:17.340069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1483/2804] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:18.214277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:18.214976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:18.221276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:18.221757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:18.222222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:18.222907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:18.223371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:18.223795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:18.351020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:18.358992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7664c3ed-801c-4864-b93d-a41dd73e4ed6 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148550 Aug 08 17:28:18.359559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1484/2805] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:18 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:18.363899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:18.364501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:18.370200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:18.370712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:18.371148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:18.371828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:18.372282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:18.372707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:18.497824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:18.506251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5eb354df-c692-4ea9-8b91-7a3b9dd20b29 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.145744 Aug 08 17:28:18.506812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1485/2806] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:19.380067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:19.380718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:19.387165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:19.387652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:19.388091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:19.388779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:19.389236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:19.389664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:19.518379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:19.526722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-058467a6-fdf7-4b53-a714-0cfe60a9f4f7 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150511 Aug 08 17:28:19.527285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1486/2807] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:19 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:19.531627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:19.532238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:19.538259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:19.538759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:19.539206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:19.539895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:19.540358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:19.540790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:19.672471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:19.680607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-82797862-4087-482d-b444-8e7320fdbf4e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.152390 Aug 08 17:28:19.681177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1487/2808] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:20.547706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:20.548331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:20.555123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:20.555604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:20.556047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:20.556749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:20.557199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:20.557618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:20.688212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:20.696057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f04689fc-e57a-48ca-862a-1b1f02175491 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152321 Aug 08 17:28:20.696616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1488/2809] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:20 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:20.701716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:20.702339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:20.707985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:20.708451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:20.708884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:20.709558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:20.710035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:20.710456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:20.839395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:20.847188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-96c7610c-b143-47a0-99a8-f80bfa7edfda tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148827 Aug 08 17:28:20.847743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1489/2810] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:21.716547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:21.717220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:21.724330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:21.724811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:21.725247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:21.725963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:21.726420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:21.726848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:21.852264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:21.860622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa5055b0-24fa-41fe-a960-faddae57187e tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148008 Aug 08 17:28:21.861180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1490/2811] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:21 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:21.868130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:21.868993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:21.874745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:21.875224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:21.875659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:21.876339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:21.876791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:21.877221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:22.007258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:22.010726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:22.015476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e934d651-0624-4f4d-be1c-3dd292eb046e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150974 Aug 08 17:28:22.016048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1491/2812] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:22.881464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:22.882166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:22.888681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:22.889166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:22.889604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:22.890803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:22.891257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:22.891681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:23.016838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:23.024633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a03c8621-31ab-4c00-93ce-de7e9fcfee98 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147363 Aug 08 17:28:23.025191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1492/2813] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:22 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:23.036356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:23.036966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:23.042492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:23.042972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:23.043407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:23.044092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:23.044547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:23.044973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:23.171066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:23.178997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9b6692cc-9c9c-4324-954a-d287ce279e03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146066 Aug 08 17:28:23.179560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1493/2814] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:24.046112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:24.046842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:24.053309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:24.053854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:24.054294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:24.054978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:24.055433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:24.055858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:24.186171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:24.194952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3dc07ae7-6c9d-43ee-8d90-3a47cb69ed20 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152655 Aug 08 17:28:24.195504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1494/2815] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:24 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:24.202099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:24.203278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:24.208871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:24.209351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:24.209814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:24.210507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:24.210958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:24.211381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:24.338974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:24.346782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8ddfeba-16f1-41fb-bee0-e31f9ee70100 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148179 Aug 08 17:28:24.347342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1495/2816] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:25.216405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:25.217083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:25.224146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:25.224640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:25.225084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:25.225772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:25.226255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:25.226683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:25.354609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:25.363572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-45ffe5e6-b118-451b-afcb-177fa5bdfef1 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150911 Aug 08 17:28:25.364153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1496/2817] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:25 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:25.368848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:25.369450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:25.375200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:25.378045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:25.378045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:25.378045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:25.378045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:25.378487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:25.507897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:25.515986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5a7c1252-ddd1-47b1-a50f-655e236035fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.150732 Aug 08 17:28:25.517133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1497/2818] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:26.384929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:26.385701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:26.392752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:26.393232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:26.393669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:26.394387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:26.394842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:26.395266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:26.521002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:26.528933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc7f9209-1e7c-4d2c-b391-598b039edc5a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147933 Aug 08 17:28:26.529494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1498/2819] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:26 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:26.536531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:26.537136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:26.542894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:26.543378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:26.543812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:26.544490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:26.544941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:26.545364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:26.673973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:26.681751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e69863a3-3564-47a4-8505-66501a047bb3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148772 Aug 08 17:28:26.682336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1499/2820] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:27.550132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:27.550823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:27.557195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:27.557676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:27.558154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:27.558841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:27.559294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:27.559720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:27.684510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:27.692990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3d9da2c8-d6b7-4d52-93b5-159a20537959 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147198 Aug 08 17:28:27.693546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1500/2821] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:27 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:27.702975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:27.703619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:27.709553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:27.710076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:27.710511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:27.711188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:27.711635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:27.712053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:27.839122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:27.847375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1df69968-4b11-49c3-9075-950c1c2daffc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147972 Aug 08 17:28:27.847927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1501/2822] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:28.713975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:28.714642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:28.721056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:28.721534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:28.721994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:28.722701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:28.723123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:28.723538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:28.850021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:28.857880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d176ec1d-7bf4-4d4c-845a-4ca40d5447a5 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147798 Aug 08 17:28:28.860648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1502/2823] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:28 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:28.869007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:28.869695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:28.876144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:28.876628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:28.877073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:28.877779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:28.883637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:28.883637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:29.005096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:29.012974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ba87f1e2-8073-4e01-a03e-cbb3747c4718 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.148209 Aug 08 17:28:29.013530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1503/2824] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:29.878799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:29.879422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:29.885915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:29.886400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:29.886840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:29.887521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:29.887979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:29.888402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:30.015154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:30.023657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-13bcfd48-d94f-4b25-b140-b64246550e9a tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148736 Aug 08 17:28:30.024218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1504/2825] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:29 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:30.033640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:30.034276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:30.039901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:30.040378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:30.040807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:30.041485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:30.041992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:30.042412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:30.169447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:30.177270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f5f0ee53-1849-4509-af50-f3c9a3ce0a3f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147237 Aug 08 17:28:30.177840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1505/2826] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:31.044373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:31.045063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:31.051908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:31.052391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:31.052817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:31.053494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:31.054000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:31.054420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:31.185192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:31.193199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cfa11bad-f1dd-4bef-b83f-deb69e41c140 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.152684 Aug 08 17:28:31.193765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1506/2827] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:31 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:31.198868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:31.210565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:31.210565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:31.210565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:31.210565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:31.211011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:31.211011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:31.211011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:31.333897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:31.341694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1cad1f18-89b8-450d-b7f2-a188d162d5fe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.146454 Aug 08 17:28:31.342270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1507/2828] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:32.214216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:32.214866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:32.221098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:32.221673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:32.222024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:32.222705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:32.223154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:32.223579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:32.241668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:32.352578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:32.360654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-902c0ca5-0a65-4541-908b-1d9d9b56544d tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150358 Aug 08 17:28:32.361214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1508/2829] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:32 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:32.365539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:32.366183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:32.371974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:32.372450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:32.372878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:32.373553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:32.374023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:32.374443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:32.502349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:32.510137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-af9f5cc6-82e5-4261-b93b-475764ba779e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.147980 Aug 08 17:28:32.510692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1509/2830] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:33.382069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:33.382733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:33.389282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:33.389764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:33.390224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:33.390920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:33.391352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:33.391770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:33.518061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:33.525879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e8ae7666-fc21-480c-93b7-b31a8c7abb79 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.148396 Aug 08 17:28:33.526459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1510/2831] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:33 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:33.530992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:33.531593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:33.537646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:33.538158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:33.538587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:33.539258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:33.539704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:33.540131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:33.669339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:33.677170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90b714c6-c3ff-44d1-af8c-acdb1ae8c711 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.149569 Aug 08 17:28:33.677730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1511/2832] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:34.547339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:34.547999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:34.555018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:34.555499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:34.555935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:34.556616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:34.557067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:34.557494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:34.686374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:34.694419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3e8d617-df6e-4c49-8f75-3f4c2993eb92 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.150897 Aug 08 17:28:34.694978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1512/2833] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:34 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:34.699302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:34.699898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:34.705683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:34.706203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:34.706670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:34.707390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:34.707848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:34.708273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:35.069090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:35.076940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c61e9d6a-db7d-4c93-b10e-e7cb266c0bc0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.381051 Aug 08 17:28:35.077503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1513/2834] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:35.714729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:35.715390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] [instance: ce9e3502-9913-4006-a9e2-a7c235f37e0d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:35.721732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:35.722248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:35.722680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:35.723358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:35.723811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:35.724230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:35.849810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e941c29e3df944a08f18f5e029a28977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b568870ecc4e4797919608bd9273ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:35.858204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09d69a3d-1a72-4eca-b9a0-853fa7bd79a3 tempest-VolumesSnapshotTestJSON-1069868239 tempest-VolumesSnapshotTestJSON-1069868239-project] 10.222.0.57 "GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d" status: 200 len: 1559 microversion: 2.1 time: 0.147237 Aug 08 17:28:35.858767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1514/2835] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:35 2022] GET /compute/v2.1/servers/ce9e3502-9913-4006-a9e2-a7c235f37e0d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:36.099298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:36.099892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:36.105793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:36.106304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:36.106766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:36.107459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:36.107917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:36.108342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:36.241432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:36.249586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fae068ae-13a9-440e-aa0f-52933344792b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1723 microversion: 2.1 time: 0.155610 Aug 08 17:28:36.250527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1515/2836] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:37.272021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:37.272639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:37.275145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:37.281182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:37.281690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:37.282188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:37.284567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:37.284895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:37.285379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:37.351906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:37.360070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-da8cee70-7a32-48fd-a6e7-291a9404013a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1657 microversion: 2.1 time: 0.092157 Aug 08 17:28:37.360632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1516/2837] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:28:37.540439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c06d12-050a-4dbb-9d04-30953de7661e", "name": "network-vif-deleted", "tag": "4bf152b4-252b-448e-a10e-bed9b31db08b"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:28:37.550926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:37.551339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:37.551824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:37.562906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] Creating event network-vif-deleted:4bf152b4-252b-448e-a10e-bed9b31db08b for instance 97c06d12-050a-4dbb-9d04-30953de7661e on hv-cinder-85221 Aug 08 17:28:37.568578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-f60e12aa-def8-4e3e-9328-c8a8d55107df req-3d91d766-6413-4a9f-81aa-30aeb413c01e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Aug 08 17:28:37.569174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1517/2838] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:28:38.381852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:38.382672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:38.389046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:38.389609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:38.390082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:38.390806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:38.391258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:38.391679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:38.465048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:38.473567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e4621ae-d837-4d2b-ad99-2c0966bc5b8b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.096448 Aug 08 17:28:38.474278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1518/2839] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:39.495348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:39.496054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:39.502882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:39.503364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:39.503800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:39.504486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:39.504938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:39.505361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:39.565115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:39.572916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2959b7cb-9016-442f-aa6f-3f02d6fa89e1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081716 Aug 08 17:28:39.573470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1519/2840] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:39 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:40.593256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:40.593886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:40.600271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:40.601490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:40.602044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:40.602773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:40.603237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:40.603665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:40.669633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:40.677531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8763a270-f6b5-4f7a-8eb9-4a6d88fe1582 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.088118 Aug 08 17:28:40.678116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1520/2841] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:41.698200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:41.698826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:41.705712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:41.706218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:41.706655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:41.707327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:41.707774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:41.708196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:41.767836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:41.775631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-118e13da-06b6-422c-b1db-a97d8800f44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081210 Aug 08 17:28:41.776182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1521/2842] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:42.796278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:42.796922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:42.804242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:42.804726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:42.805164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:42.805879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:42.806336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:42.806761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:42.866020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:42.874007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8c5d837-1530-47a2-8705-7d75810bfcec tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081422 Aug 08 17:28:42.874566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1522/2843] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:43.895083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:43.895720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:43.901956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:43.902442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:43.902876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:43.903559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:43.904012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:43.904436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:43.964262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:43.972705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b2492f2-0365-4dca-be52-b859eb67bfad tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082004 Aug 08 17:28:43.973260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1523/2844] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:44.410765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:28:44.411008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:28:44.993766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:44.994554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:45.000866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:45.001353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:45.001811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:45.002491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:45.002948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:45.003373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:45.065286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:45.073321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8550ab5c-1239-41b3-8fde-25f4d40a601d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083386 Aug 08 17:28:45.074256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1524/2845] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:46.095503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:46.096204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:46.102568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:46.103050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:46.103487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:46.104170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:46.104625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:46.105048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:46.165110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:46.168505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:28:46.173415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-02e81a1f-f81b-4317-b0fe-43bc3e310fa6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082473 Aug 08 17:28:46.173998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1525/2846] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:47.194857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:47.195554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:47.202002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:47.202487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:47.202927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:47.203643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:47.204099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:47.204525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:47.266652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:47.274530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-da1d356a-6520-4ebe-9e24-26678c2891cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084040 Aug 08 17:28:47.275084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1526/2847] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:48.295634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:48.296266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:48.302631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:48.303112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:48.303546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:48.304227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:48.304680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:48.305105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:48.365608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:48.373682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ab72fc1c-bbd4-4043-aa6f-a796521efb27 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081951 Aug 08 17:28:48.374268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1527/2848] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:49.396356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:49.397028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:49.403327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:49.403804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:49.404238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:49.404918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:49.405370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:49.405811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:49.469405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:49.477608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-08985aeb-90a6-4b65-a25d-ff23a85bd026 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086640 Aug 08 17:28:49.478194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1528/2849] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:50.498721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:50.499353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:50.505746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:50.506258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:50.506697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:50.507382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:50.507837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:50.508262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:50.568822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:50.576647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bb3dc967-a262-48bf-b0b7-a666288b6934 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081852 Aug 08 17:28:50.577202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1529/2850] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:50 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:51.597171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:51.597780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:51.604185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:51.604660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:51.605097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:51.605774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:51.606243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:51.606661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:51.666995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:51.675249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa825b2e-c1c8-4975-85b6-dc41ef1fafbe tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081968 Aug 08 17:28:51.675805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1530/2851] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:52.696220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:52.696837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:52.703189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:52.703717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:52.704154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:52.704846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:52.705297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:52.705725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:52.766295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:52.774654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99227e6d-30c3-4890-b1ac-96d849381dc8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082767 Aug 08 17:28:52.775263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1531/2852] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:53.795993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:53.796639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:53.803150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:53.803664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:53.804099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:53.804780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:53.805229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:53.805652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:53.871002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:53.878933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b11f552d-cb3b-4d36-869d-8d648960538e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086792 Aug 08 17:28:53.880017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1532/2853] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:54.900508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:54.901144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:54.907687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:54.908201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:54.908635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:54.909317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:54.909764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:54.910212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:54.970987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:54.978940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9bca2d34-9a3e-4f35-bc0e-ee19d4a5b5f9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082239 Aug 08 17:28:54.979486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1533/2854] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:56.000553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:56.001209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:56.007722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:56.008202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:56.008659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:56.009340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:56.009810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:56.010254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:56.070146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:56.077870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7a580c01-3424-41ce-abd0-508992d8c398 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081242 Aug 08 17:28:56.078423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1534/2855] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:57.099051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:57.099736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:57.106110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:57.106594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:57.107035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:57.107718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:57.108173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:57.108600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:57.169830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:57.178384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-acc3fac6-bde3-4a85-bb3f-603bb3733be9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083681 Aug 08 17:28:57.178947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1535/2856] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:58.198477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:58.199162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:58.205469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:58.205984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:58.206422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:58.207106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:58.207563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:58.207988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:58.271304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:58.279160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-364b4558-eb08-466e-af7f-d3f6a99fb221 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084532 Aug 08 17:28:58.279720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1536/2857] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:28:59.299755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:28:59.300464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:28:59.306752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:59.307227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:59.307658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:59.308333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:28:59.308782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:28:59.309204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:28:59.368799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:28:59.376673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64fef8d4-1996-40a6-bbf9-fcd70469ed4d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.080759 Aug 08 17:28:59.377225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1537/2858] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:28:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:00.398098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:00.398771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:00.405077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:00.405547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:00.406027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:00.406705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:00.407148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:00.407566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:00.467428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:00.475833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b7d97cb-6aa9-429b-8f51-0306e084aa9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082124 Aug 08 17:29:00.476387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1538/2859] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:00 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:01.496385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:01.497041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:01.503363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:01.503863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:01.504295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:01.504974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:01.505423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:01.505869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:01.568148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:01.575882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e79f2fe-682f-4105-b822-cc22690e9801 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083318 Aug 08 17:29:01.576443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1539/2860] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:01 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:02.596729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:02.597341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:02.604463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:02.605174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:02.605608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:02.606385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:02.606780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:02.607200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:02.671628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:02.679677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9d4408a-dd0c-4d35-a65f-92b7f03b7708 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.087033 Aug 08 17:29:02.680237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1540/2861] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:03.700000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:03.700645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:03.707013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:03.707489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:03.707916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:03.708590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:03.709036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:03.709458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:03.769732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:03.777646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0d25435-333b-430b-8da4-ca095d10a11b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081469 Aug 08 17:29:03.778237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1541/2862] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:04.797934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:04.798561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:04.805488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:04.806010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:04.806449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:04.807129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:04.807583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:04.808007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:04.826059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:04.868516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:04.876208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f89125c-0bd8-4720-9af4-f6a6073738bd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082152 Aug 08 17:29:04.876765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1542/2863] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:05.896802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:05.897483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:05.903860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:05.904346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:05.904782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:05.905463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:05.905946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:05.906370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:05.966602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:05.974887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe320282-fb21-4576-99d7-8cf37e940c5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081908 Aug 08 17:29:05.975446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1543/2864] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:06.995490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:06.996150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:07.002498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:07.002982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:07.003420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:07.004751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:07.005203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:07.005628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:07.071949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:07.079758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-389c52d8-a861-47f0-8b33-6fbcdb3e4dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.088391 Aug 08 17:29:07.080317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1544/2865] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:08.100739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:08.101397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:08.103701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=58 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:08.108326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:08.108808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:08.109244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:08.109956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:08.110412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:08.110867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:08.173500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:08.181983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e0965296-438e-45bc-a7c3-114d0c82bd64 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085519 Aug 08 17:29:08.182545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1545/2866] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:09.202056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:09.202733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:09.209758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:09.210264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:09.210695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:09.211375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:09.211827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:09.212248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:09.271906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:09.279830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6a75c83d-ad7b-4f49-a537-45ddf68a34d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081702 Aug 08 17:29:09.280388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1546/2867] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:09.494681 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:29:09.495239 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:29:10.300288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:10.300870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:10.307219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:10.307691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:10.308120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:10.308795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:10.309244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:10.309664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:10.370412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:10.378170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42afadb7-b65a-4179-b242-8b0bfe1c4364 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081730 Aug 08 17:29:10.379224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1547/2868] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:11.399267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:11.399959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:11.406269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:11.406754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:11.407219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:11.407903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:11.408357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:11.408781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:11.471734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:11.479989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e96d0d2-7405-4edf-a187-e88b52c7dd5c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084607 Aug 08 17:29:11.480549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1548/2869] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:12.501625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:12.502247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:12.509207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:12.509672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:12.510139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:12.510825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:12.511283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:12.511709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:12.571661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:12.579731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-65a08b09-a519-4bd5-a70e-c0a627ace0df tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081968 Aug 08 17:29:12.580287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1549/2870] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:12 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:13.600112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:13.600713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:13.607182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:13.607663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:13.608098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:13.608781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:13.609233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:13.609656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:13.669622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:13.677315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4d85639-d035-4b7b-ab41-d4fcb52e37fc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081085 Aug 08 17:29:13.677889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1550/2871] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:14.698179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:14.698827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:14.705159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:14.705636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:14.706094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:14.707272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:14.707721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:14.708141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:14.767826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:14.776060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99eba0f4-2a60-4b77-8826-cd5f07caf8f7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081775 Aug 08 17:29:14.776612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1551/2872] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:15.797452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:15.798109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:15.805125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:15.805603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:15.806067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:15.806745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:15.807193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:15.807611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:15.871998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:15.879925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f414a9b9-2340-420b-b168-f1b6d969a3fb tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086364 Aug 08 17:29:15.880479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1552/2873] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:16.900573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:16.901244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:16.907154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:16.907637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:16.908107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:16.908791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:16.909244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:16.909700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:16.969397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:16.977173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9d34550-a944-414e-9018-9b538418fe03 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.080565 Aug 08 17:29:16.977733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1553/2874] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:17.998631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:17.999265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:18.006162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:18.006651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:18.007091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:18.007799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:18.008258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:18.008685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:18.068750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:18.076536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7398683c-b588-4116-9a97-09be6be23f98 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081803 Aug 08 17:29:18.077100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1554/2875] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:19.098180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:19.098836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:19.105154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:19.105628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:19.106123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:19.106798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:19.107245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:19.107663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:19.167894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:19.175828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0852316a-db30-4119-b074-3b72ddd9d4b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082106 Aug 08 17:29:19.176426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1555/2876] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:20.195817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:20.196489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:20.202720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:20.203206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:20.203629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:20.204299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:20.204745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:20.205165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:20.268227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:20.276102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db633fbd-7853-4206-b951-5460c10225b8 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084112 Aug 08 17:29:20.279299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1556/2877] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:21.296515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:21.297160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:21.304060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:21.304550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:21.305025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:21.305722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:21.306228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:21.325524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:21.368708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:21.376703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c42d43e-299c-408f-98e8-aa0db6489ace tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084058 Aug 08 17:29:21.377265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1557/2878] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:22.398579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:22.399239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:22.405504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:22.406020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:22.406454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:22.407126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:22.407571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:22.408017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:22.468364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:22.476180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-202c3b66-9555-43d7-9396-ae9468cd93d9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081552 Aug 08 17:29:22.476730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1558/2879] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:23.496714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:23.497359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:23.503718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:23.504194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:23.504626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:23.505311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:23.505759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:23.506246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:23.510092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:23.569137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:23.577125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ee9ca9b-f32d-4912-bc35-86f372e8da91 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084329 Aug 08 17:29:23.577682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1559/2880] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:23 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:24.598697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:24.599341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:24.605738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:24.606250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:24.606695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:24.607376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:24.607829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:24.608251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:24.672332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:24.680930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4437f78f-35f1-453a-a98d-fa8d9eb37c65 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086529 Aug 08 17:29:24.681488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1560/2881] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:25.701458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:25.702171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:25.709076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:25.709562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:25.710031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:25.710726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:25.711187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:25.711615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:25.771743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:25.779509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6123a50a-1147-4244-b95b-36009fd29623 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081933 Aug 08 17:29:25.780069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1561/2882] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:26.800376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:26.801023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:26.807727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:26.808206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:26.808644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:26.809333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:26.809796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:26.810233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:26.871206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:26.879840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-39188e79-5adb-4f20-a6d7-ededc9a1462c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083297 Aug 08 17:29:26.880399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1562/2883] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:27.900745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:27.901416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:27.907782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:27.908272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:27.908715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:27.909405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:27.909894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:27.910324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:27.970463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:27.978233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aad0a893-3fd9-41e0-8af6-907e27d9bda2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081382 Aug 08 17:29:27.978792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1563/2884] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:29:28.999835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:29.000516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:29.007029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:29.007511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:29.007970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:29.008656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:29.009112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:29.009539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:29.072336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:29.080352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3765989-195c-48b1-80e2-9ba4642ecc00 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084372 Aug 08 17:29:29.080913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1564/2885] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:30.101858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:30.102470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:30.108709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:30.109191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:30.109646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:30.110357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:30.110803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:30.111224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:30.173258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:30.181747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c06d068b-5989-4827-8370-e9fdf30fcee1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084341 Aug 08 17:29:30.182321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1565/2886] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:31.201850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:31.202546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:31.208712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:31.209184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:31.209642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:31.210346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:31.210795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:31.211214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:31.272479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:31.280296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53fd3d8c-573c-47f8-baac-38f401cfc57d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082315 Aug 08 17:29:31.280846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1566/2887] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:32.301097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:32.301836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:32.308243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:32.308721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:32.309157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:32.309869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:32.310326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:32.310747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:32.372120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:32.380515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e3b76e6-4dd2-4980-bc75-95d05f97e947 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082715 Aug 08 17:29:32.381099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1567/2888] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:33.400657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:33.401325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:33.407685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:33.408185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:33.408615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:33.409287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:33.409733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:33.410180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:33.474222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:33.482140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6366964-ec8b-4bd8-8012-e55752ca1c66 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085306 Aug 08 17:29:33.482683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1568/2889] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:34.550649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:34.551239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:34.557180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:34.557665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:34.558147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:34.558841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:34.559300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:34.559729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:34.622802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:34.631123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a55db0d-574e-4ff8-a90a-295e44ff1c47 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.132114 Aug 08 17:29:34.631675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1569/2890] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:34 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:35.652041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:35.652701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:35.659091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:35.659573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:35.660011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:35.660692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:35.661772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:35.662222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:35.721451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:35.729907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-418c7e2e-3994-42b1-96aa-97e48f8e3c4b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081716 Aug 08 17:29:35.730479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1570/2891] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:36.750684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:36.751346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:36.757878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:36.758366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:36.758801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:36.759493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:36.759948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:36.760374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:36.820319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:36.828165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49c92911-f80a-4e29-9761-f6ec0ebc82c3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081416 Aug 08 17:29:36.828721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1571/2892] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:36 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:37.848669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:37.849293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:37.855650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:37.856131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:37.856566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:37.857246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:37.857696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:37.858146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:37.922634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:37.930941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb5de9b1-11fe-4536-974a-dc00a3d63d95 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086100 Aug 08 17:29:37.931498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1572/2893] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:37 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:38.951881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:38.952486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:38.954768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:38.959930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:38.965155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:38.965155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:38.965155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:38.965155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:38.965583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:39.023074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:39.030839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8a7ab0e-152b-4b90-ae10-d031c0c8650e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082763 Aug 08 17:29:39.031392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1573/2894] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:38 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:40.051658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:40.052331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:40.058648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:40.059121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:40.059552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:40.060223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:40.060670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:40.061087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:40.120669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:40.128630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9545d74-2255-4a3f-84a5-c830a5135d36 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.080830 Aug 08 17:29:40.129212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1574/2895] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:40 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:41.149053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:41.149698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:41.156112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:41.156573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:41.157008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:41.157688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:41.158166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:41.158592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:41.218779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:41.222095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:41.227256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1507b49b-eba6-4b97-a22e-fc2611477cfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081989 Aug 08 17:29:41.227806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1575/2896] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:41 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:42.248806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:42.249459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:42.256478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:42.256952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:42.257382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:42.258087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:42.258538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:42.258960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:42.321754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:42.329595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b8daecb-8d3d-428b-a8c8-abe8ed4b444e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085010 Aug 08 17:29:42.330311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1576/2897] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:42 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:43.350614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:43.351305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:43.357740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:43.358245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:43.358681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:43.359370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:43.359879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:43.360304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:43.420632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:43.428455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ced46215-ee02-40d5-ae8a-25afad4d3ed5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081797 Aug 08 17:29:43.429014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1577/2898] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:43 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:44.448845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:44.449453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:44.455850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:44.456328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:44.456760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:44.457477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:44.457970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:44.458391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:44.520389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:44.528177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6644b95a-3bdb-4bae-b42f-c2dcebeddeb5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083149 Aug 08 17:29:44.528747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1578/2899] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:44 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:45.548517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:45.549151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:45.556343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:45.556827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:45.557266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:45.557984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:45.558440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:45.558861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:45.619118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:45.626964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe7d9648-19bc-43bd-b4ab-2b2755e83156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082366 Aug 08 17:29:45.627524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1579/2900] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:45 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:46.647343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:46.647967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:46.654076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:46.654556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:46.654993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:46.655678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:46.656131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:46.656553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:46.719288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:46.727778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8b0befa-9469-4597-a9d5-7b395cc20f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084319 Aug 08 17:29:46.728334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1580/2901] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:46 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:47.748608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:47.749276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:47.755793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:47.756280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:47.756729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:47.757408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:47.757885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:47.758308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:47.818851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:47.826588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-10c09384-533c-4452-a93e-4b36d7aa196b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081918 Aug 08 17:29:47.827139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1581/2902] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:47 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:48.847688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:48.848349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:48.854708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:48.855189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:48.855624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:48.856310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:48.856764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:48.857191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:48.917118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:48.924909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-43868559-c8bb-41f4-91ba-d45829b47f07 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081068 Aug 08 17:29:48.925461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1582/2903] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:48 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:49.946069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:49.946712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:49.952911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:49.953386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:49.953834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:49.954512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:49.954959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:49.955376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:50.017174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:50.025455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d77df1ff-ffe3-4d9a-b2a8-450e864ea7ee tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083345 Aug 08 17:29:50.026037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1583/2904] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:49 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:51.047160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:51.047772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:51.054704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:51.055180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:51.055640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:51.056313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:51.056761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:51.057180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:51.119829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:51.127665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68693cd3-5c2e-4dec-a978-61b51d179816 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084323 Aug 08 17:29:51.128223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1584/2905] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:51 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:52.147438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:52.148094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:52.154482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:52.154964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:52.155398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:52.156086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:52.156541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:52.156992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:52.223749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:52.231685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5438c18-8551-49b2-b7dc-ee1d322a4447 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.088132 Aug 08 17:29:52.232459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1585/2906] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:52 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:53.256003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:53.256650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:53.263026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:53.263531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:53.263964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:53.264635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:53.265082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:53.265500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:53.326014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:53.333729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-33c30992-aac9-4ec5-aa52-ee0cca2cc601 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081566 Aug 08 17:29:53.334308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1586/2907] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:53 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:54.354376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:54.355084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:54.361345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:54.361854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:54.362295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:54.362979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:54.363936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:54.364359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:54.423528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:54.431802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11589cfb-c72d-473a-acb5-c12f3d5a87d1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081312 Aug 08 17:29:54.432364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1587/2908] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:54 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:55.453256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:55.453991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:55.461169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:55.461651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:55.462120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:55.462806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:55.463259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:55.463676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:55.526627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:55.534430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f759abd4-73b1-4eb1-8813-8444a47c3c33 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085088 Aug 08 17:29:55.535025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1588/2909] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:55 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:56.555458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:56.556070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:56.562491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:56.562976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:56.563412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:56.564092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:56.564543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:56.564967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:56.625309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:56.634004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb44053e-d1c9-4d63-b87a-cac1f7469289 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082364 Aug 08 17:29:56.634563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1589/2910] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:56 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:57.654590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:57.655230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:57.661579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:57.662083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:57.662519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:57.663191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:57.663638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:57.664057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:57.724087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:57.731884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e0eaa942-c3ed-404f-a820-d2bfd21650cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081128 Aug 08 17:29:57.732430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1590/2911] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:57 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:58.752931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:58.754151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:58.760539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:58.761015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:58.761446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:58.762152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:58.762604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:58.763158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:58.822853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:58.830564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0db05923-435e-4c45-98d0-7c0c2461d916 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081495 Aug 08 17:29:58.831120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1591/2912] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:58 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:29:59.851389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:29:59.852146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:29:59.858972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:59.859448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:59.859985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:59.860665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:29:59.861111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:29:59.861527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:29:59.881692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:29:59.927732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:29:59.935611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e3c2bc43-b19d-4ed4-8c9c-b887b65631db tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.088691 Aug 08 17:29:59.936175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1592/2913] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:29:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:00.956166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:00.956842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:00.963194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:00.963679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:00.964128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:00.964817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:00.965273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:00.965700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:01.025665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:01.033525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-17a446f4-c116-423f-b655-a999373ba6d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081337 Aug 08 17:30:01.034125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1593/2914] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:00 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:02.054309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:02.055030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:02.061341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:02.061850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:02.062294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:02.062974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:02.063426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:02.063848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:02.135242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:02.135242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-24ac956e-59a3-4057-a226-e4e8e3c8e702 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081677 Aug 08 17:30:02.135242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1594/2915] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:02 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:03.152944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:03.153633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:03.159999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:03.160486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:03.160927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:03.161617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:03.162105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:03.162537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:03.222593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:03.230711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b28493a9-9bda-438c-8c03-77d187bfcf56 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081865 Aug 08 17:30:03.231305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1595/2916] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:03 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:04.252173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:04.355151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:04.355151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:04.355151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:04.355151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:04.356460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:04.356460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:04.356460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:04.356761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:04.356761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-847eb571-6bf3-419e-adfc-af9abd7fe07c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085536 Aug 08 17:30:04.356761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1596/2917] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:04 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:05.355172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:05.355889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:05.362166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:05.362656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:05.363094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:05.363781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:05.364494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:05.364925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:05.425569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:05.433463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d8a9b480-3a8a-4b19-8ce1-159f971307a2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082807 Aug 08 17:30:05.434061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1597/2918] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:05 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:06.453830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:06.454454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:06.460867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:06.461352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:06.461810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:06.463062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:06.463517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:06.463943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:06.526149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:06.534013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b06f29b6-2842-43c6-b414-3f87d7d9b717 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084048 Aug 08 17:30:06.534574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1598/2919] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:06 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:07.554577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:07.555279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:07.562090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:07.562573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:07.563009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:07.563689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:07.564141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:07.564565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:07.625648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:07.633423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c52fa21b-5f62-4c4e-93e3-da78e3b75184 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082677 Aug 08 17:30:07.634638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1599/2920] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:07 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:08.655035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:08.655629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:08.662335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:08.662815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:08.663250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:08.663927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:08.664377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:08.664797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:08.728054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:08.735810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3513ca9f-c496-4bc4-82e6-c8da659e6dde tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084619 Aug 08 17:30:08.736362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1600/2921] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:08 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:09.756108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:09.756770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:09.759636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:09.764301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:09.769710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:09.769710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:09.769710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:09.769710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:09.770140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:09.828048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:09.835822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5802452-1198-4bba-b776-ed89988bbaa9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083577 Aug 08 17:30:09.836385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1601/2922] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:09 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:10.855891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:10.856592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:10.862833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:10.863312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:10.863990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:10.864727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:10.865180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:10.865603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:10.926382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:10.934752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4a84f9ea-1586-4b36-94db-ad5319d0c074 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082835 Aug 08 17:30:10.935309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1602/2923] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:10 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:11.955564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:11.956174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:11.962505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:11.962986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:11.963418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:11.964111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:11.964566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:11.964990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:12.025212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:12.032984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8ebf7efa-39e6-4daf-a5b9-e6c83317e629 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081331 Aug 08 17:30:12.033542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1603/2924] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:11 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:13.054647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:13.055283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:13.061587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:13.062101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:13.062547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:13.063231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:13.063686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:13.064111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:13.128458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:13.136352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-22e3167d-bf70-410b-b5eb-0e19d5327156 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085536 Aug 08 17:30:13.136916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1604/2925] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:13 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:14.156618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:14.157221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:14.163560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:14.164043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:14.164482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:14.165169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:14.165627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:14.166077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:14.225486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:14.233336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-525f27a4-ad0a-4d83-9b65-85961c87fa3a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.080706 Aug 08 17:30:14.233917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1605/2926] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:14 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:15.254003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:15.254669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:15.261538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:15.262045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:15.262479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:15.263161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:15.263612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:15.264029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:15.324137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:15.331844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d523a28c-b264-489e-9cc5-b88b0940bc3b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081795 Aug 08 17:30:15.332393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1606/2927] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:15 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:16.352501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:16.353215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:16.359181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:16.359663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:16.360097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:16.360776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:16.361223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:16.361643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:16.421866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:16.429593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1feb29b3-87a3-4a7c-878c-c1d61b26ac5b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081114 Aug 08 17:30:16.430828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1607/2928] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:16 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:17.450732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:17.451409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:17.457692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:17.458205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:17.458644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:17.459325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:17.459779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:17.460238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:17.523383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:17.531777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c3e13d7-53a0-4dcf-8ba2-1a5a9dd89705 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084937 Aug 08 17:30:17.532336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1608/2929] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:17 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:18.552865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:18.553500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:18.559938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:18.560424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:18.560863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:18.561547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:18.562039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:18.562463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:18.566418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:18.623595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:18.631445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c367ac7d-b921-4e55-8d55-6d0deef165c0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082416 Aug 08 17:30:18.632006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1609/2930] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:18 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:19.652912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:19.653529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:19.659973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:19.660454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:19.660893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:19.661572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:19.662062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:19.662489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:19.724150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:19.732758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1732d5a3-fcdd-4ef8-9730-0a7104cddb2e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084218 Aug 08 17:30:19.733315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1610/2931] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:19 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:19.877598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:30:19.877815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:30:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:30:20.753352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:20.754045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:20.761250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:20.761726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:20.762232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:20.762927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:20.763385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:20.763815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:20.827196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:20.835398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8743be70-4d1b-4f9f-bed8-57e8a20d0c54 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.085885 Aug 08 17:30:20.835974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1611/2932] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:20 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:21.594961 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:30:21.595433 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:30:21.857131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:21.857680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:21.864277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:21.864753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:21.865187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:21.865888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:21.866339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:21.866757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:21.929023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:21.936789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b69fa759-3016-48ab-aee5-16974f66c01c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083591 Aug 08 17:30:21.937339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1612/2933] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:21 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:22.957229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:22.958031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:22.964899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:22.965379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:22.965838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:22.966519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:22.966968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:22.967387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:23.027306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:23.035033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-64e6f6af-3d6c-4f34-814a-4477cfb2592a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081616 Aug 08 17:30:23.035583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1613/2934] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:22 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:24.056415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:24.057098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:24.063512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:24.063999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:24.064440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:24.065169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:24.065630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:24.066088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:24.126925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:24.134773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1cfec2b0-24f7-4f8e-9e82-0da1a5c45203 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082201 Aug 08 17:30:24.135339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1614/2935] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:24 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:25.155493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:25.156157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:25.162522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:25.163004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:25.163443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:25.164797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:25.165256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:25.165684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:25.225322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:25.233127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-741be1a9-c56a-4cae-8b5f-52ab811af3d0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081485 Aug 08 17:30:25.233710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1615/2936] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:25 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:25.453726 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:30:25.454197 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:30:26.253120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:26.253734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:26.260220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:26.260702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:26.261138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:26.261846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:26.262303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:26.262726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:26.325014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:26.332889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8da5db20-9891-4a6b-beb6-b2f8ebeeeaf0 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083588 Aug 08 17:30:26.333451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1616/2937] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:26 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:27.353885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:27.354500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:27.360796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:27.361272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:27.361704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:27.362406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:27.362854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:27.363523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:27.425954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:27.434282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a53f6873-1c90-475d-b42c-bd8149520b51 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.084241 Aug 08 17:30:27.434833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1617/2938] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:27 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:28.454984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:28.455661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:28.462700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:28.463211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:28.463529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:28.464204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:28.464650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:28.465068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:28.525165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:28.533268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-45dd78c3-a0a4-4248-a5b5-462c60fe52f6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081804 Aug 08 17:30:28.533844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1618/2939] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:28 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:29.554113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:29.555327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:29.562155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:29.562638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:29.563076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:29.563767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:29.564220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:29.564646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:29.625605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:29.634104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-844aa10d-e485-42a2-bdcc-cf2ad200bdf9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083768 Aug 08 17:30:29.634667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1619/2940] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:29 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:30.654521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:30.655142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:30.661509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:30.662034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:30.662476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:30.663165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:30.663637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:30.664065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:30.726480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:30.734382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d85c54c6-5197-44b6-9b82-880a302c2c7e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.083721 Aug 08 17:30:30.734946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1620/2941] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:30 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:31.754941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:31.755594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:31.762081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:31.762570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:31.763006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:31.763691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:31.764149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:31.764576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:31.824506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:31.832285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b68e70fd-ce39-4f8d-80bb-fb5011df8734 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081236 Aug 08 17:30:31.832844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1621/2942] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:31 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:32.853557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:32.854195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:32.860577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:32.861061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:32.861502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:32.862220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:32.862680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:32.863373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:32.923188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:32.931559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4be049aa-b618-47ea-9b2c-b7593576ac63 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.082380 Aug 08 17:30:32.932109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1622/2943] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:32 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:33.952003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:33.954106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:33.958701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:33.959177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:33.959611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:33.960323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:33.960776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:33.961200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:34.021538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:34.029373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4031bf78-23b0-49c4-8f56-5e8c07b11149 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.081189 Aug 08 17:30:34.030042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1623/2944] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:33 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:35.050618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:35.051265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:35.058212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:35.058696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:35.059137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:35.059827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:35.060280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:35.060702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:35.125527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:35.133497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8e20622a-baaf-4479-a954-22a7b0acefcc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 200 len: 1370 microversion: 2.1 time: 0.086723 Aug 08 17:30:35.134089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1624/2945] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:35 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:35.154659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c9439cbf-ba42-4bf3-b787-d42038a35303 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '.version_select at 0x7f7438942a60>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:35.255982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c9439cbf-ba42-4bf3-b787-d42038a35303 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89640920" status: 202 len: 0 microversion: 2.1 time: 0.104705 Aug 08 17:30:35.256555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1625/2946] 10.222.0.57 () {58 vars in 1215 bytes} [Mon Aug 8 17:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89640920 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:30:36.570260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8f92eeed-fe4a-4847-a717-9b1188d04b8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: .version_select at 0x7f7438732160>, body: {"keypair": {"name": "tempest-keypair-382873782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiVWyBN95dgMHwoHUCwqXkxdnD+c+pvEjIQCYFy45zyL6YYeDFzoA7f0boxxoIF2l/YZnUrzPoZ2TS4qXxeEuA0gVPxlAUky5kbgT3AOiO+xL8Oz6MNo3tk9ECmN8TlGQ=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:30:36.591689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-8f92eeed-fe4a-4847-a717-9b1188d04b8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:30:36.597001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-8f92eeed-fe4a-4847-a717-9b1188d04b8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:30:36.674007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8f92eeed-fe4a-4847-a717-9b1188d04b8d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107483 Aug 08 17:30:36.674773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1626/2947] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:30:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:30:36.697006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:36.697618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:36.704090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:36.704784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:36.705292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:36.706033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:36.706540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:36.706904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:36.732081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:30:36.734906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:37.103437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-efb92638-50cb-4827-a64f-b6359d3d59e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 204 len: 0 microversion: 2.1 time: 0.409370 Aug 08 17:30:37.103587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1627/2948] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:30:36 2022] DELETE /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:30:37.111529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:37.112218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:37.118484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:37.118965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:37.119408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:37.120089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:37.120543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:37.120956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:37.253316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:37.261953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aca2e098-a930-4e1e-9b84-338bf822cf27 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154323 Aug 08 17:30:37.262525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1628/2949] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:30:38.283604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:38.285126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:38.291465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:38.291952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:38.292427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:38.293089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:38.293572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:38.294040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:38.494927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:38.503032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d800e68-62dd-4f6d-9342-023d02470c33 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.223250 Aug 08 17:30:38.503629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1629/2950] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:30:38.843936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1342278202", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36f0450b-5607-4e0f-8828-7eaf46e83a10"}], "security_groups": [{"name": "tempest-securitygroup--600186274"}], "key_name": "tempest-keypair-382873782", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:30:38.943462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] validate_networks() for [('36f0450b-5607-4e0f-8828-7eaf46e83a10', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:30:39.298498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:30:39.299129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:30:39.299381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:30:39.299789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:30:39.300196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:30:39.308783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:39.309255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:39.309685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:39.310424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:39.310879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:39.311298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:39.327966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:30:39.331793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:30:39.342916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:30:39.345108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:30:39.477716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0aa82bf-c5ce-43b7-9a43-ac9aedcad3b3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638026 Aug 08 17:30:39.478436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1630/2951] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:30:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:30:39.489316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecfc0848-d46c-42db-bfd6-5c45fa4f50f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:39.489989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ecfc0848-d46c-42db-bfd6-5c45fa4f50f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:39.549000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ecfc0848-d46c-42db-bfd6-5c45fa4f50f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:39.556452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ecfc0848-d46c-42db-bfd6-5c45fa4f50f2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1241 microversion: 2.1 time: 0.071113 Aug 08 17:30:39.557020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1631/2952] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:39 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:39.640440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:39.641059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:39.647401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:39.647883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:39.648315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:39.649001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:39.649651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:39.650112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:39.781500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:39.789385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e78fad0a-3b10-46fd-957f-bf6b6e5707e5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.231436 Aug 08 17:30:39.790466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1632/2953] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:30:40.576907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:40.577608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:40.579965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:40.584790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:40.585277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:40.585713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:40.586453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:40.587481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:40.588127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:40.652277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:40.659532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bc13ec3a-b6f7-4527-89b9-d78a3e02aab3 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1245 microversion: 2.1 time: 0.086472 Aug 08 17:30:40.660115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1633/2954] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:40 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:40.810088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:40.810792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:40.816918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:40.819141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:40.819141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:40.819141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:40.819141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:40.819635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:41.173754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:41.181774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8f0d8512-bcad-4f9e-b791-57177ec16e31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.375895 Aug 08 17:30:41.182349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1634/2955] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:41.679870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:41.681517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:41.689394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:41.690005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:41.690559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:41.691345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:41.691866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:41.692355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:41.756295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:41.764551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-267a783c-85e1-4b35-a32a-adba247bff18 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1301 microversion: 2.1 time: 0.088490 Aug 08 17:30:41.765118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1635/2956] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:41 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:30:42.202576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:42.203208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:42.209006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:42.209483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:42.209957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:42.210629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:42.211075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:42.212102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:42.347563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:42.357428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4d48c759-da4f-4e94-a687-7437e7016edf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157396 Aug 08 17:30:42.357428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1636/2957] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:42.790471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:42.791131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:42.797587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:42.798098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:42.798535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:42.799223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:42.799674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:42.800095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:42.933721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:42.941127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9e5a167e-d16e-437f-b67d-adc2ae2f41e6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.155247 Aug 08 17:30:42.941705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1637/2958] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:42 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:43.115852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c346445-9089-4df6-a9ae-ad2483c9814f", "tag": "bd6d60f0-0abe-4982-933f-51294b5bae58"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:30:43.125663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:43.126178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:43.126614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:43.137892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] Creating event network-changed:bd6d60f0-0abe-4982-933f-51294b5bae58 for instance 8c346445-9089-4df6-a9ae-ad2483c9814f on hv-cinder-85221 Aug 08 17:30:43.141912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-6b19c935-ef19-43c0-aaae-88a889d635c2 req-74327b2f-55c4-45cc-8d8a-532f458af2bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029913 Aug 08 17:30:43.142514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1638/2959] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:30:43.378503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:43.379196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:43.385209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:43.385690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:43.386167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:43.386852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:43.387300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:43.387724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:43.517584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:43.526327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e3229fd0-2ec5-480f-8101-69ab791c8462 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152118 Aug 08 17:30:43.526913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1639/2960] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:43.961775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:43.962460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:43.968736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:43.970100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:43.970100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:43.970388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:43.970810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:43.971232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:44.112227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:44.120284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dbecafc7-5509-4fb3-b30a-a70ca32f5ea9 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.162419 Aug 08 17:30:44.120843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1640/2961] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:43 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:44.547197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:44.547831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:44.553769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:44.554275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:44.554711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:44.556020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:44.556473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:44.556899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:44.683411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:44.691310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15d3d788-bb3e-47c3-a273-99c03390a741 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148031 Aug 08 17:30:44.691869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1641/2962] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:45.140468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:45.141158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:45.147445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:45.147932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:45.148368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:45.149696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:45.150177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:45.150607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:45.275577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:45.282901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5a9243a0-4f0a-4a52-bdd8-0639c8c1b5a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.146229 Aug 08 17:30:45.283457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1642/2963] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:45 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:45.711959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:45.712564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:45.718748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:45.719225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:45.719655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:45.720338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:45.720789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:45.721209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:45.851838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:45.860224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e073989d-f930-4fff-8420-d56ffb75cfb2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152183 Aug 08 17:30:45.860778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1643/2964] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:46.302921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:46.303559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:46.309369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:46.309871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:46.310309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:46.310980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:46.311426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:46.311846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:46.437117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:46.444421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3816343-55e8-41c1-b80c-a3d5ba676596 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.145438 Aug 08 17:30:46.444973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1644/2965] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:46 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:46.882423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:46.882940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:46.889839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:46.890324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:46.890753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:46.891429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:46.891876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:46.892298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:46.896390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:47.024529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:47.032375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35d1fe48-30e7-47f3-ad42-e77ebdc815e0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153782 Aug 08 17:30:47.032941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1645/2966] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:47.463824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:47.464478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:47.470807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:47.471287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:47.471722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:47.472415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:47.472866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:47.473288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:47.604796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:47.612583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1471017d-a43d-46b4-9e5a-ba4a24d2f955 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.152286 Aug 08 17:30:47.613234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1646/2967] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:47 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:48.053136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:48.053779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:48.059734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:48.060219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:48.060657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:48.061382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:48.061858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:48.062284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:48.190342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:48.198654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75586a44-6464-4de9-882c-3ffb53f3da2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149371 Aug 08 17:30:48.199218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1647/2968] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:48.634275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:48.634890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:48.641325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:48.641827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:48.642267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:48.642949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:48.643405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:48.643829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:48.768711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:48.776045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-939b8dff-9e74-44c4-8977-d78f5bd728c6 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.146226 Aug 08 17:30:48.776604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1648/2969] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:48 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:49.220086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:49.220706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:49.226671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:49.227702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:49.228136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:49.228815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:49.229266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:49.229689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:49.317228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:49.360624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:49.366623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-785b28d8-f3ba-424f-bcc3-c810e17812e4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150440 Aug 08 17:30:49.367173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1649/2970] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:49.512220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c346445-9089-4df6-a9ae-ad2483c9814f", "name": "network-vif-plugged", "status": "completed", "tag": "bd6d60f0-0abe-4982-933f-51294b5bae58"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:30:49.521949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:49.522423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:49.522849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:49.535750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] Creating event network-vif-plugged:bd6d60f0-0abe-4982-933f-51294b5bae58 for instance 8c346445-9089-4df6-a9ae-ad2483c9814f on hv-cinder-85221 Aug 08 17:30:49.541578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-db251c01-baf8-4c69-878a-46fb64319375 req-2a055aa2-c48c-454f-989c-046f4621dd6f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Aug 08 17:30:49.542203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1650/2971] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:30:49.793836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=12 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:49.798734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:49.799433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:49.805421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:49.805938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:49.806379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:49.807058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:49.807512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:49.807936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:49.941270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:49.949711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6088998c-18b6-40a0-8617-6d5770c6466b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.156835 Aug 08 17:30:49.950313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1651/2972] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:49 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:50.388035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:50.388577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:50.394727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:50.395238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:50.395677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:50.399107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:50.399107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:50.399107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:50.525148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:50.533112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76939ae6-b84a-4873-8211-6f22e79cbf35 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149407 Aug 08 17:30:50.533673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1652/2973] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:50.970271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:50.970941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:50.977307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:50.977809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:50.978250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:50.978933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:50.979386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:50.979812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:51.109952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:51.118472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f5a00dbb-d48f-4841-a47e-875096b3bf9e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1366 microversion: 2.1 time: 0.151281 Aug 08 17:30:51.119086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1653/2974] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:50 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:51.554555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:51.555164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:51.561325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:51.561821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:51.562258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:51.562934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:51.563381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:51.563807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:51.697941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:51.705843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a1deb7f-9c56-477a-8ec5-54a547d48da6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155074 Aug 08 17:30:51.706409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1654/2975] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:52.138773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:52.139413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:52.145851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.146337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.146776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.147462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.147918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.148344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.276243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:52.283698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35d242e9-6f80-4416-a5c8-d9c51431859b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1556 microversion: 2.1 time: 0.148793 Aug 08 17:30:52.284255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1655/2976] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:52 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:52.303617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:52.304135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:52.309705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.313849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.313849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.313849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.313849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.314252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.392530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccdde581-4fa9-4f41-9d74-3c4bb2e29507 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092379 Aug 08 17:30:52.393168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1656/2977] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:30:52 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:30:52.730484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:52.731125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:52.737334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.737834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.738271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.738953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:52.739404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:52.739825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:52.943976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:52.952722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-48fa69b1-34ae-4b95-8d68-528b822b1ad0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.226226 Aug 08 17:30:52.953304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1657/2978] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:53.413842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c346445-9089-4df6-a9ae-ad2483c9814f", "tag": "bd6d60f0-0abe-4982-933f-51294b5bae58"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:30:53.424040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:53.425156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:53.425598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:53.437493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] Creating event network-changed:bd6d60f0-0abe-4982-933f-51294b5bae58 for instance 8c346445-9089-4df6-a9ae-ad2483c9814f on hv-cinder-85221 Aug 08 17:30:53.442520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-3a795ea1-a10c-4ae7-9f38-20e6ef006ef4 req-b2a2f04b-7864-402c-b9ac-ab66cadba705 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032389 Aug 08 17:30:53.443128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1658/2979] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:30:53.974532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:53.975240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:53.981864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:53.982360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:53.982806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:53.983510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:53.983974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:53.984402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:54.121202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:54.129268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18e4487f-746f-40fb-872c-7b85607b3dc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.158953 Aug 08 17:30:54.130057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1659/2980] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:55.150896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:55.151558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:55.157915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:55.158400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:55.158834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:55.159514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:55.159968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:55.160394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:55.288831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:55.297276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-34f1086e-9eb3-408d-8497-42abd8487e97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150721 Aug 08 17:30:55.298017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1660/2981] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:56.318907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:56.319581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:56.326029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:56.326514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:56.326954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:56.327641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:56.328098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:56.328525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:56.457196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:56.465363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f78bfaf8-1c48-49d5-9732-cf01dd04c260 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150387 Aug 08 17:30:56.471065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1661/2982] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:57.487049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:57.487722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:57.494556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:57.495031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:57.495461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:57.496140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:57.496589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:57.497009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:57.623567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:57.631535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fcef6964-9c31-436d-b306-1d592fcebbdd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148568 Aug 08 17:30:57.632112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1662/2983] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:58.652932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:58.653563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:58.660009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:58.660486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:58.660916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:58.661619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:58.662092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:58.662516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:58.679849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:30:58.792733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:58.800550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-62bfba98-a5eb-4a4b-913a-0a642185f464 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152075 Aug 08 17:30:58.801106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1663/2984] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:30:59.823128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:30:59.823865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:30:59.830259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:59.830749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:59.831177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:59.831849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:30:59.832383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:30:59.832799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:30:59.960279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:30:59.968610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c612c99f-a21a-4c74-90e6-e370dd3c44c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150306 Aug 08 17:30:59.969173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1664/2985] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:30:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:00.990525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:00.991198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:00.998139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:00.998620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:00.999058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:00.999740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:01.000199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:01.000624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:01.133039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:01.140843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-acbe983d-ada9-4244-b8f8-4d7fcfdfd929 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154435 Aug 08 17:31:01.141411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1665/2986] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:02.162248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:02.162967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:02.169170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:02.169643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:02.170118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:02.170797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:02.171250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:02.171673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:02.298299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:02.306830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3ceb55b8-1574-4a45-888d-178dc6c7fd0f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148386 Aug 08 17:31:02.307388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1666/2987] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:03.327733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:03.328443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:03.334779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:03.335298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:03.335733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:03.336763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:03.337156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:03.337365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:03.468981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:03.476910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70e24bbf-2426-46b4-aeeb-47b034b6cc97 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153156 Aug 08 17:31:03.477469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1667/2988] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:04.498826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:04.499463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:04.507302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:04.507783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:04.508796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:04.509476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:04.509958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:04.510379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:04.639851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:04.647669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9f564d88-6536-445f-a26c-49ecd720eaea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152704 Aug 08 17:31:04.648225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1668/2989] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:05.670861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:05.671468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:05.677851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:05.678340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:05.678783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:05.679468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:05.679926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:05.680351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:05.808805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:05.816701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad9fbca6-1b3b-4958-8e3a-56baec68ffc4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149756 Aug 08 17:31:05.817270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1669/2990] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:06.837538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:06.838210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:06.844459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:06.844951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:06.845393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:06.846108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:06.846571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:06.847002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:06.976245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:06.984707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb4990b6-cab2-4181-8774-6f2d4198e0aa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151030 Aug 08 17:31:06.985268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1670/2991] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:08.006530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:08.007175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:08.014349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:08.014836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:08.015273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:08.015963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:08.016415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:08.016838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:08.141380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:08.149269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-efd667ba-c830-4ca3-ae7b-4c707edb835f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146491 Aug 08 17:31:08.149884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1671/2992] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:09.172068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:09.172745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:09.179020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:09.179523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:09.179958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:09.180634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:09.181082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:09.181502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:09.313024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:09.321318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5a680d6-1b36-4a83-bb5c-efd3f2a5f058 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153049 Aug 08 17:31:09.322467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1672/2993] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:10.342967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:10.343645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:10.350033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:10.350516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:10.350952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:10.352198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:10.352652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:10.353079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:10.478801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:10.486952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-662519c9-f277-41e0-bf20-96b8b8f80a8b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147811 Aug 08 17:31:10.487515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1673/2994] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:11.508558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:11.509245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:11.511585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=82 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:11.516236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:11.516719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:11.517159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:11.517870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:11.518332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:11.518760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:11.645565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:11.654105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42bc825f-cef0-4f59-a94a-24c29bc00ad6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149859 Aug 08 17:31:11.654667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1674/2995] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:12.674637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:12.675232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:12.681601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:12.682147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:12.682592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:12.683281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:12.683739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:12.684166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:12.813717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:12.822141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f47044e9-a25b-4d76-8be3-28377106ed86 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151418 Aug 08 17:31:12.822707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1675/2996] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:13.843242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:13.843952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:13.850222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:13.850704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:13.851149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:13.851831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:13.852287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:13.852709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:13.979027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:13.987112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-483bd9b5-5ef9-4a0d-97b4-a9e48d5469a6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147853 Aug 08 17:31:13.987667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1676/2997] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:15.008918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:15.009590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:15.015895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:15.016373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:15.016811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:15.017504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:15.017965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:15.018385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:15.149356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:15.157096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a8cca5d-3c6d-44f7-b31d-268f31e1290b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152502 Aug 08 17:31:15.157662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1677/2998] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:16.178690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:16.179850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:16.185692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:16.186197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:16.186629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:16.187302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:16.187749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:16.188165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:16.316120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:16.324732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c09d869-5458-4ee8-ad27-7340acd7c88b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150015 Aug 08 17:31:16.325291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1678/2999] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:17.345642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:17.346440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:17.352642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:17.353119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:17.353555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:17.354267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:17.354723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:17.355182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:17.483252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:17.491372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75374706-cd4e-4b00-a5c9-c0664f6ae702 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149640 Aug 08 17:31:17.491933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1679/3000] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:18.512324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:18.512935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:18.519328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:18.519809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:18.520250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:18.520928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:18.521383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:18.521827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:18.526246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:18.649808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:18.658014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e68839d7-be38-40da-8114-742110314460 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149406 Aug 08 17:31:18.658594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1680/3001] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:19.680682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:19.681342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:19.687789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:19.688278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:19.688711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:19.689393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:19.689894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:19.690322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:19.817283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:19.825263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cbc39e6e-6e03-4c2a-8b4c-78e925015a18 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149052 Aug 08 17:31:19.825847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1681/3002] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:20.846657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:20.847301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:20.853734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:20.854283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:20.854727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:20.855421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:20.855880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:20.856307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:20.987204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:20.995594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75f8226c-acab-458b-9bfa-23948f0d6577 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152940 Aug 08 17:31:20.996161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1682/3003] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:22.017202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:22.017846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:22.024927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:22.025412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:22.025874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:22.026559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:22.027010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:22.027435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:22.155131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:22.163152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3ee1010a-2126-4bca-b0cc-18164c41bafe tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149896 Aug 08 17:31:22.163714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1683/3004] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:23.184170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:23.184852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:23.191098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:23.191575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:23.192007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:23.192680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:23.193131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:23.193551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:23.322619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:23.330546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c831aa5-3410-46c9-8d5d-318df460090c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150237 Aug 08 17:31:23.333600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1684/3005] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:24.352573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:24.353329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:24.359931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:24.360411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:24.361110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:24.361800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:24.362261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:24.362683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:24.503166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:24.511220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9490bdee-a02f-4a24-82da-578e6004c759 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.162946 Aug 08 17:31:24.511784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1685/3006] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:25.532495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:25.533205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:25.540280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:25.540764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:25.541200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:25.541938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:25.542386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:25.542807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:25.669169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:25.677158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2db96eb2-07fd-486d-acb3-ab3b1064aaa9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148553 Aug 08 17:31:25.677721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1686/3007] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:26.697653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:26.698299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:26.704707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:26.705189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:26.705627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:26.706342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:26.706797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:26.707223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:26.839206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:26.847140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5161d789-ff89-466b-b6a7-be1828d1c4f9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153279 Aug 08 17:31:26.847700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1687/3008] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:27.869030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:27.869657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:27.875850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:27.876326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:27.876757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:27.877430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:27.877907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:27.878359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:28.003475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:28.011863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ffd880ed-8bae-44de-a0d8-071d6c75b0c0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147363 Aug 08 17:31:28.012419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1688/3009] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:29.033154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:29.033818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:29.040884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:29.041364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:29.041834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:29.042522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:29.042977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:29.043403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:29.171301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:29.179142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-877e3ea2-4e08-4757-b07c-d4574833b797 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149805 Aug 08 17:31:29.179706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1689/3010] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:29.464080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:29.464578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:29.470543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:29.471030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:29.471464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:29.472142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:29.472594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:29.473019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:29.495583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6916ebc-7787-4977-bf8c-994dcf1d9f1e tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035888 Aug 08 17:31:29.496145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1690/3011] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:31:29 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:31:30.199413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:30.200071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:30.206420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:30.206908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:30.207356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:30.208041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:30.208499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:30.208928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:30.339004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:30.348126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7439be79-dfc8-49a8-825b-c8bc6f9ff563 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152041 Aug 08 17:31:30.348944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1691/3012] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:31.370813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:31.371411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:31.377922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:31.378401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:31.378832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:31.379513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:31.379961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:31.380380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:31.512461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:31.520481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-72cd09b0-e210-4644-8a48-f8f8a7271be2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153473 Aug 08 17:31:31.521077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1692/3013] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:32.542917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:32.543572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:32.549983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:32.550467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:32.550905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:32.551590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:32.552046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:32.552470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:32.680685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:32.688735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f11e9136-368b-4140-af60-a533765cb1e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149764 Aug 08 17:31:32.689298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1693/3014] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:33.710317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:33.710983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:33.717302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:33.717802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:33.718245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:33.718928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:33.719381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:33.719806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:33.846167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:33.854330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-98a65fdd-213c-4b24-902e-126d8e2ae870 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148350 Aug 08 17:31:33.854900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1694/3015] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:34.875789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:34.876453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:34.882817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:34.883299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:34.883735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:34.884420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:34.884875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:34.885298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:35.013807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:35.021678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-226df2e6-4d9c-4277-b840-2c7fb39eb33d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149960 Aug 08 17:31:35.026231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1695/3016] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:36.044074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:36.044783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:36.051094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:36.051579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:36.052016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:36.052700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:36.053152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:36.054242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:36.180601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:36.188580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-55c00641-081c-44af-88fa-95ca19f1da8a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148675 Aug 08 17:31:36.192625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1696/3017] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:37.211019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:37.211687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:37.217944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:37.218418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:37.218847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:37.219544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:37.219993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:37.220411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:37.224313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:37.350227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:37.358853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a033ba1a-0642-452f-8eba-e79b2f69855b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152018 Aug 08 17:31:37.359418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1697/3018] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:38.381352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:38.382045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:38.388910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:38.389391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:38.389850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:38.390536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:38.390990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:38.391412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:38.519678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:38.528052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ea739e7-999d-4ab3-ab20-1800f97a62d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150784 Aug 08 17:31:38.528616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1698/3019] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:39.548261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:39.548907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:39.555520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:39.556006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:39.556447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:39.557138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:39.557591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:39.558044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:39.683238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:39.691168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38210963-1922-4fb9-9753-e7f88c2b113d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146707 Aug 08 17:31:39.691734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1699/3020] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:40.712309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:40.713029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:40.719446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:40.724278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:40.724278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:40.724278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:40.724278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:40.724715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:40.857058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:40.865595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-228c6f3c-616e-4c8b-8ed2-523127d74352 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157110 Aug 08 17:31:40.866187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1700/3021] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:41.887580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:41.888236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:41.890521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=54 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.895150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:41.895629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:41.896064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:41.896748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:41.897205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:41.897627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:42.024123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:42.032002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ebc2a4e5-eebc-4e37-86a7-9ec98b76af51 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148953 Aug 08 17:31:42.032560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1701/3022] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:43.053196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:43.053928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:43.060747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:43.061227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:43.061665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:43.062375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:43.062834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:43.063260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:43.417971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:43.425860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7aff9941-9160-4720-b831-8335e6cc8ca2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.376443 Aug 08 17:31:43.426448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1702/3023] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:44.448037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:44.448708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:44.455152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:44.455637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:44.456078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:44.456769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:44.457228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:44.457657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:44.585352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:44.593537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ecbefe51-1f02-4ccd-8d29-d6ed35557c0d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149817 Aug 08 17:31:44.594238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1703/3024] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:45.615192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:45.615803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:45.624080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:45.624496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:45.624958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:45.625640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:45.626115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:45.626535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:45.755108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:45.763491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4bd3ed2b-85a4-4d44-9117-e58dd98f1eaf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152183 Aug 08 17:31:45.764061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1704/3025] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:46.784647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:46.785266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:46.791448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:46.791927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:46.792361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:46.793039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:46.793491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:46.793952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:46.921235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:46.929099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0c355e5-6cf6-4821-ba8b-ed9b5bb5da14 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148329 Aug 08 17:31:46.929666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1705/3026] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:47.951661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:47.952315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:47.958571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:47.959052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:47.959489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:47.960168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:47.960622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:47.961044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:48.089059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:48.096930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b3489c3-3de9-4940-9ad7-17a2593e6027 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149206 Aug 08 17:31:48.097488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1706/3027] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:49.118279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:49.118949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:49.125464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:49.125978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:49.126414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:49.127127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:49.127576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:49.128024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:49.256697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:49.264587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6d0e8ac0-1528-43c3-8464-4a121e157092 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150197 Aug 08 17:31:49.265145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1707/3028] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:50.285912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:50.286609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:50.293500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:50.294011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:50.294452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:50.295166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:50.295624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:50.296050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:50.422506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:50.431314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-131dadc4-38ba-4be4-8aed-fc7f46741d99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148558 Aug 08 17:31:50.432023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1708/3029] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:51.452362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:51.453029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:51.459473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:51.459951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:51.460385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:51.461064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:51.461520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:51.462462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:51.591868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:51.599899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c32597f-7688-4f6d-a4e0-02fdbdbd8d2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151342 Aug 08 17:31:51.600460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1709/3030] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:52.622206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:52.622830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:52.629254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:52.629739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:52.630238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:52.630922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:52.631377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:52.631798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:52.758154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:52.766307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-802d0fd3-3b5d-453f-9c60-bcbb48968b90 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148019 Aug 08 17:31:52.766871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1710/3031] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:53.787467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:53.788101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:53.794679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:53.795165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:53.795635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:53.796320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:53.796778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:53.797204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:53.931900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:53.939878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c46ac193-99bf-4094-85de-eb170a8e5c6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.156253 Aug 08 17:31:53.940444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1711/3032] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:54.960463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:54.961115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:54.967357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:54.967836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:54.968269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:54.968947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:54.969392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:54.969829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:55.250315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:55.258081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9eb3e601-4a76-42e7-884a-43f7324395d3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.301508 Aug 08 17:31:55.258637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1712/3033] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:56.278891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:56.279581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:56.285777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:56.286298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:56.286729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:56.287403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:56.287856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:56.288272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:56.413571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:56.417436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.422100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99559b20-41e3-426c-895b-a5893b832f1c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147002 Aug 08 17:31:56.422655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1713/3034] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:57.444811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:57.445480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:57.452555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:57.453039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:57.453471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:57.454255 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:57.454700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:57.455380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:57.583985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:57.591902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59ce879a-b389-4313-aef9-88a67b14a4b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151546 Aug 08 17:31:57.592458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1714/3035] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:58.612556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:58.613157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:58.620157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:58.620636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:58.621066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:58.621740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:58.622218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:58.622634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:58.747257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:58.755091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51434826-2c29-470a-be5f-85c776894576 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146535 Aug 08 17:31:58.755597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1715/3036] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:59.775883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:31:59.776516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:31:59.783089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:59.783573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:59.784008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:59.784697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:31:59.785149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:31:59.785567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:31:59.919413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:31:59.927301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-61483748-419f-4a30-b8fb-e7f8b810f06d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155255 Aug 08 17:31:59.927855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1716/3037] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:31:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:00.949502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:00.950180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:00.956463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:00.956949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:00.957388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:00.958102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:00.958562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:00.959001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:01.096008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:01.103861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad2d8ec0-2ac6-4e5d-b7d6-b0b6137f9d75 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.158827 Aug 08 17:32:01.104420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1717/3038] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:02.125098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:02.125841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:02.132065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:02.132548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:02.132989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:02.133739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:02.134223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:02.134646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:02.264280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:02.272419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ec1adf4-31c1-40bc-96ef-c7a5739b6102 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151184 Aug 08 17:32:02.272984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1718/3039] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:03.292792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:03.293467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:03.299861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:03.300340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:03.300774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:03.301455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:03.301936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:03.302364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:03.434597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:03.442634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c2204290-7f50-4d45-a603-3838f1599789 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153757 Aug 08 17:32:03.443193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1719/3040] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:04.464766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:04.465456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:04.471825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:04.472306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:04.472740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:04.473416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:04.473898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:04.474323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:04.603076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:04.611360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28f92019-60c2-4c4b-895c-ddc9fe21ae32 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151047 Aug 08 17:32:04.611958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1720/3041] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:05.632153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:05.632770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:05.639008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:05.639484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:05.639912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:05.640590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:05.641040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:05.641462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:05.769671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:05.778116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-31666a1d-3a4d-4f0b-bb7e-836bcdef80b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149785 Aug 08 17:32:05.778670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1721/3042] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:06.799971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:06.800617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:06.807023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:06.808154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:06.808585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:06.809263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:06.809711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:06.810171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:06.936275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:06.944050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05c172de-8e41-40cd-9b4b-19aee0bc1236 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147945 Aug 08 17:32:06.944606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1722/3043] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:07.964971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:07.965644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:07.971966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:07.972458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:07.972900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:07.973594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:07.974085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:07.974520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:08.103841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:08.111963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9c7f9a6a-5c0d-4a5e-9771-2a0d9a67b38b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150911 Aug 08 17:32:08.112521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1723/3044] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:09.133506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:09.134176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:09.140922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:09.141401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:09.141853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:09.142535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:09.142990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:09.143411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:09.272638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:09.280382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6cacbf3-a995-4688-9f88-97d142d9d4e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150804 Aug 08 17:32:09.280940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1724/3045] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:10.301501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:10.302193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:10.308540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:10.309021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:10.309456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:10.310178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:10.310632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:10.311058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:10.437090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:10.445006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b57ac52b-be3e-4836-baed-2b62bb053a3a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147398 Aug 08 17:32:10.445558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1725/3046] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:11.466463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:11.467155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:11.473432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:11.473952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:11.474393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:11.475075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:11.475530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:11.475949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:11.607169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:11.615262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-162de530-d9e3-4605-b17f-4a97308ca37d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152698 Aug 08 17:32:11.615819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1726/3047] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:12.635960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:12.636582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:12.638865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=52 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:12.643474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:12.648333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:12.648333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:12.648333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:12.648333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:12.648778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:12.772167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:12.779877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76cc42c4-d0e7-49e0-9247-b0610c6de791 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148327 Aug 08 17:32:12.780427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1727/3048] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:13.800436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:13.801094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:13.807495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:13.807971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:13.808402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:13.809081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:13.809530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:13.809995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:13.939251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:13.947024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d621f71-7be5-4c70-a16c-b2fb8beeff25 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150431 Aug 08 17:32:13.947601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1728/3049] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:14.968343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:14.968972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:14.975362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:14.975838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:14.976268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:14.976943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:14.977392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:14.977835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:15.106626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:15.114744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1bbf55d8-a732-4145-b752-65f26aeb5b93 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150218 Aug 08 17:32:15.115307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1729/3050] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:16.137034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:16.137657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:16.144035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:16.144509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:16.144949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:16.145626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:16.146101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:16.146518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:16.163691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:16.274145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:16.282102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c49e5c98-a6d0-4dbb-aba1-13d2267162b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149522 Aug 08 17:32:16.282654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1730/3051] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:17.302888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:17.303573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:17.309879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:17.310369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:17.310806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:17.311490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:17.311942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:17.312395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:17.441676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:17.450085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c1d13b4d-3927-441d-88e4-dfafe3bfa1f5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150978 Aug 08 17:32:17.450649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1731/3052] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:18.471703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:18.472384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:18.479390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:18.479872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:18.480331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:18.481014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:18.481466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:18.481916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:18.611114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:18.619437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-57f4234c-2d8c-47e8-b8cd-884eaaafab49 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151103 Aug 08 17:32:18.619989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1732/3053] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:19.643744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:19.644382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:19.650853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:19.651345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:19.651785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:19.652494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:19.652949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:19.653374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:19.783669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:19.792220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e45b6c45-d696-4ae7-823f-4503008580c2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152319 Aug 08 17:32:19.792780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1733/3054] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:20.813502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:20.814151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:20.820389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:20.820872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:20.821304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:20.822597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:20.823050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:20.823471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:20.949451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:20.957413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e547f6b4-f67b-49bd-b0e3-3bbee2fd0b8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147846 Aug 08 17:32:20.958006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1734/3055] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:21.979123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:21.979779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:21.986792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:21.987281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:21.987780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:21.989204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:21.989669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:21.990129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:22.124066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:22.132008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9898fac2-fd79-4f5f-978a-1b4bddc081c3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157351 Aug 08 17:32:22.132575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1735/3056] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:23.153605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:23.154302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:23.160791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:23.161301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:23.161735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:23.162441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:23.162889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:23.163309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:23.288982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:23.296956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f2e94df9-53c8-487f-9545-cce7ef14cbb4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147773 Aug 08 17:32:23.297518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1736/3057] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:24.318266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:24.318943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:24.327345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:24.327823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:24.328256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:24.328935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:24.329385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:24.329830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:24.457345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:24.465830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c0578648-71e3-4bc8-8d35-8597f26d16d2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151349 Aug 08 17:32:24.466386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1737/3058] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:25.487422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:25.488171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:25.495203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:25.495685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:25.496123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:25.496855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:25.497312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:25.497741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:25.628042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:25.635912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81765b06-7f2d-42c3-8f04-fad459d2f222 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152715 Aug 08 17:32:25.636497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1738/3059] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:26.656925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:26.657498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:26.663926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:26.664402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:26.664835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:26.665512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:26.665995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:26.666419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:26.791402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:26.799161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ef8cf0ea-f80e-47e7-9374-16935699fedf tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146140 Aug 08 17:32:26.799730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1739/3060] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:27.819792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:27.820439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:27.826968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:27.827452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:27.827895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:27.828581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:27.829039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:27.829467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:27.957283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:27.965629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c03914d3-6dd1-46e0-a0ec-0efd5f2b1826 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149677 Aug 08 17:32:27.966214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1740/3061] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:28.986830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:28.987494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:28.993767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:28.994269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:28.994704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:28.995973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:28.996435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:28.996855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:29.124391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:29.132240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4cc3d90b-64cb-45ce-97ed-7b4d10f601b4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149607 Aug 08 17:32:29.132800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1741/3062] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:29.502707 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:32:29.503272 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:32:29.570924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:29.571370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:29.577762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:29.578271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:29.578718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:29.579399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:29.579848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:29.580267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:29.605748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:32:29.915675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ac03fdd-6afb-4248-a40a-f8ffcc869971 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 204 len: 0 microversion: 2.1 time: 0.348380 Aug 08 17:32:29.916257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1742/3063] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:32:29 2022] DELETE /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:29.924456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:29.925153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:29.930951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:29.931435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:29.931867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:29.933193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:29.933641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:29.934083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:30.064566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:30.072026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3d7fb743-2e2a-41e0-8834-77aa147c1c35 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1680 microversion: 2.1 time: 0.151532 Aug 08 17:32:30.072584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1743/3064] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:29 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:30.152334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:30.152864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:30.159022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:30.159502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:30.159938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:30.160619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:30.161070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:30.161491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:30.289503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:30.297813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ede34c46-2853-419b-939d-88401912a7df tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149338 Aug 08 17:32:30.298366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1744/3065] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:31.095197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:31.095810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:31.102117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:31.102598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:31.103034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:31.103740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:31.104188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:31.104605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:31.122393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:31.236117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:31.243606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-79c5e055-9c22-40c7-92e5-221a8b3912b5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1680 microversion: 2.1 time: 0.152349 Aug 08 17:32:31.244165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1745/3066] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:31 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:31.318912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:31.319513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:31.325798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:31.326287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:31.326721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:31.327396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:31.327845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:31.328267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:31.458339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:31.466100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5bb8dff2-2dec-4300-b0df-97263cef0d73 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150925 Aug 08 17:32:31.466652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1746/3067] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:32.265064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:32.266880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:32.273618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:32.274139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:32.274582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:32.275283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:32.275741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:32.276775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:32.337909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:32.346046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0182d1c4-13eb-47ad-a25f-b5a6095de44b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1613 microversion: 2.1 time: 0.084866 Aug 08 17:32:32.346616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1747/3068] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:32 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:32.475720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c346445-9089-4df6-a9ae-ad2483c9814f", "name": "network-vif-deleted", "tag": "bd6d60f0-0abe-4982-933f-51294b5bae58"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:32.488844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:32.489401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:32.490108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:32.503123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] Creating event network-vif-deleted:bd6d60f0-0abe-4982-933f-51294b5bae58 for instance 8c346445-9089-4df6-a9ae-ad2483c9814f on hv-cinder-85221 Aug 08 17:32:32.510767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-ae50bc4e-58a8-4654-b507-90a26e414b02 req-c5ae4418-2f66-414c-ac8f-e0a6d4d3911d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087053 Aug 08 17:32:32.511952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1748/3069] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:32:32.518682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:32.519643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:32.526487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:32.527173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:32.527784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:32.529201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:32.530026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:32.530611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:32.694802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:32.703734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-895bde45-c6a9-41ce-94f1-90561ffff277 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.190353 Aug 08 17:32:32.708327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1749/3070] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:33.367639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:33.368282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:33.375278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:33.375756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:33.376179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:33.376859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:33.377316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:33.377736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:33.412681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:33.413227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:33.413708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:33.414198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lazy-loading 'fault' on Instance uuid 8c346445-9089-4df6-a9ae-ad2483c9814f {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:32:33.458173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:33.466458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5c2ae02c-36a5-4f6e-8fbf-dfe186e20296 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 200 len: 1331 microversion: 2.1 time: 0.102689 Aug 08 17:32:33.467042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1750/3071] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:33 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:33.725408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:33.726109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:33.732066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:33.732808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:33.733253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:33.733965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:33.734426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:33.734853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:33.859526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:33.867452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3a8abd3b-877c-4922-b3e7-e0a8d2cb44cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.145849 Aug 08 17:32:33.868020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1751/3072] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:34.490598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:34.491272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:34.497681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:34.498204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:34.498646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:34.499333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:34.499788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:34.500212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:34.513430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f HTTP/1.1 Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:32:34.515082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:32:34.516931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8c346445-9089-4df6-a9ae-ad2483c9814f'} Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:32:34.517973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:32:34.519658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:32:34.522108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:32:34.522108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8bb6d9f3-b270-4e89-a1c1-826d3dd93c97 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 404 len: 111 microversion: 2.1 time: 0.029880 Aug 08 17:32:34.522108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1752/3073] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:34 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:32:34.525004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ec95e9d5-5b28-4c81-8b01-08358c449f81 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '.version_select at 0x7f74391a4940>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:34.624018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ec95e9d5-5b28-4c81-8b01-08358c449f81 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382873782" status: 202 len: 0 microversion: 2.1 time: 0.102442 Aug 08 17:32:34.624590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1753/3074] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Aug 8 17:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382873782 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:32:34.889532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:34.890269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:34.896262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:34.902600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:34.902600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:34.902600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:34.902600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:34.903132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:35.033418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:35.041552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99ff4f3c-28d6-48d6-9e5a-19a3b9ea3e8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157021 Aug 08 17:32:35.042284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1754/3075] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:35.351230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-57841823-de01-41ff-9d4a-45a2058e8f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: .version_select at 0x7f74388e5d30>, body: {"keypair": {"name": "tempest-keypair-242355779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhiSsS4ddj+2tKaVLrE8RXvvRqm1motQWAq6mfrskXFeXf9jP/Grp5ayUh36ITZSi/P6oAf2DNtJckQ0BTrhYVoDJxrQQIhqN/sQDGovlCefpyDlGqFbQoxmrEotlkkPg=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:35.366664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-57841823-de01-41ff-9d4a-45a2058e8f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:32:35.370962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-57841823-de01-41ff-9d4a-45a2058e8f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:32:35.471497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-57841823-de01-41ff-9d4a-45a2058e8f7c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124095 Aug 08 17:32:35.472098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1755/3076] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:32:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:32:36.063099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:36.063705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:36.069551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:36.070057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:36.070547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:36.071278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:36.071737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:36.072166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:36.205808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:36.214554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f9b6d8b7-8d08-4c2e-b053-1f88fbb64ac3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155873 Aug 08 17:32:36.215316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1756/3077] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:37.236661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:37.238169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:37.246246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:37.246738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:37.247181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:37.247876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:37.248332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:37.248771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:37.422806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:37.432300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40a537fa-8424-41da-b10e-1424a6b3fdde tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.200140 Aug 08 17:32:37.433218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1757/3078] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:37.800749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-116830720", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36f0450b-5607-4e0f-8828-7eaf46e83a10"}], "security_groups": [{"name": "tempest-securitygroup--314195115"}], "key_name": "tempest-keypair-242355779", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:37.900584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] validate_networks() for [('36f0450b-5607-4e0f-8828-7eaf46e83a10', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:32:38.302219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:32:38.302812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:32:38.303113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:32:38.303525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:32:38.303967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:32:38.312987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:38.313461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:38.313932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:38.314653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:38.315105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:38.315529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:38.332198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:32:38.336127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Getting quotas for user 5a7ed5f2559a449fbe0b30bfeabd90df and project 880cab17504d403d89b8cfff76632c6b. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:32:38.346868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:32:38.349068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:32:38.488589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a581c408-730a-4663-8228-0f45f8f69fc7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692089 Aug 08 17:32:38.495571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1758/3079] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:32:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:32:38.495571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:38.495571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:38.497293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.502683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:38.503191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:38.503618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:38.504453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:38.504801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:38.505229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:38.652732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:38.662763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2d2e063-7039-4045-849b-22f455401104 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.172484 Aug 08 17:32:38.663280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1759/3080] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:38.668472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6989dde0-2b7d-40ba-a901-ced6935568ac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:38.669087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6989dde0-2b7d-40ba-a901-ced6935568ac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:38.727094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6989dde0-2b7d-40ba-a901-ced6935568ac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:38.734667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6989dde0-2b7d-40ba-a901-ced6935568ac tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1240 microversion: 2.1 time: 0.070351 Aug 08 17:32:38.735226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1760/3081] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:38 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:39.686575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:39.687193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:39.693751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:39.694311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:39.694747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:39.695434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:39.695899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:39.696337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:39.827649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:39.835532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de79a86e-4c96-4f46-81f6-98d6a9893c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152753 Aug 08 17:32:39.836088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1761/3082] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:39.840350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:39.840950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:39.846485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:39.846965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:39.850693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:39.850693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:39.850693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:39.850693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:39.910106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:39.917425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae17d3a8-3149-4b40-81e7-da37a443256d tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1292 microversion: 2.1 time: 0.080426 Aug 08 17:32:39.922091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1762/3083] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:39 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1292 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:40.856525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:40.857470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:40.864146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:40.864626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:40.865309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:40.866223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:40.866916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:40.867572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:41.004733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:41.012945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-309985bd-96b6-442c-b6f2-3c10cd77edd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.160316 Aug 08 17:32:41.013518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1763/3084] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:41.018109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:41.018717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:41.024669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:41.025159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:41.025633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:41.026383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:41.027159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:41.027628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:41.088676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:41.096337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b362492c-a607-49cc-adc8-aa1cbadcc147 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1298 microversion: 2.1 time: 0.081676 Aug 08 17:32:41.096842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1764/3085] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:41 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:42.034409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:42.035044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:42.041403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:42.041918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:42.042358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:42.043044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:42.043499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:42.043933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:42.181097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:42.190244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6453dca8-018e-4b4f-9cce-b89d6a035238 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.159570 Aug 08 17:32:42.190864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1765/3086] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:42.195945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfd5df8-916a-4085-93d4-26fa2756ce2f", "tag": "a3cb8f55-9a30-4b1d-b100-97cd3ada14e8"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:42.207140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:42.207730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:42.208106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:42.219199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] Creating event network-changed:a3cb8f55-9a30-4b1d-b100-97cd3ada14e8 for instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f on hv-cinder-85221 Aug 08 17:32:42.224071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-415c71aa-b65a-4762-9df4-51fb05f8a31a req-8b7a10f8-b14d-45c7-b672-1384e141ea3c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031827 Aug 08 17:32:42.224652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1766/3087] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:32:42.230208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:42.230894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:42.237265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:42.237667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:42.238262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:42.238948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:42.239399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:42.239841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:42.258087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.374264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:42.382002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-687f6a15-97af-4d3f-9859-02b60219fb68 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.156081 Aug 08 17:32:42.382577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1767/3088] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:42 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:43.214233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:43.214857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:43.221161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:43.221637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:43.222096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:43.222794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:43.223227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:43.223649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:43.349841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:43.357809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-92267609-912a-479c-8960-7f309ab1f999 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148256 Aug 08 17:32:43.358363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1768/3089] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:43.401734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:43.402356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:43.407901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:43.408376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:43.408807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:43.409479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:43.409958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:43.410372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:43.537964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:43.545966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b474386c-481f-40a1-a85d-02074753a490 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.147594 Aug 08 17:32:43.546527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1769/3090] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:43 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:44.379490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:44.380151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:44.386452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:44.386927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:44.387356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:44.388033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:44.388481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:44.388902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:44.515490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:44.523463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ae9de408-bc1e-4078-b38d-d9d923e54c8f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147806 Aug 08 17:32:44.524269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1770/3091] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:44.566624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:44.567240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:44.573541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:44.574063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:44.574503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:44.575186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:44.575644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:44.576073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:44.706542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:44.714563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4f9048d0-6987-403b-97b6-2a4b3a36483b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.151599 Aug 08 17:32:44.715126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1771/3092] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:44 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:45.545556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:45.546236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:45.552607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:45.553092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:45.553532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:45.554257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:45.554713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:45.555139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:45.686355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:45.694265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f666ef7-a58c-4377-b4c2-b1509e364c0a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152592 Aug 08 17:32:45.694829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1772/3093] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:45.735324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:45.735957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:45.741675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:45.742190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:45.742629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:45.743321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:45.743777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:45.744207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:45.867783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:45.875090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-74b28bac-c6cb-4c15-ad8c-7cb0cf1eab38 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.143573 Aug 08 17:32:45.875653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1773/3094] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:45 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:46.715174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:46.715820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:46.721911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:46.722391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:46.722825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:46.723496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:46.723943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:46.724363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:46.853878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:46.861958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f490acf3-6bca-43f6-b67c-e1fe6bbf372a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150654 Aug 08 17:32:46.862518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1774/3095] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:46.894705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:46.895303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:46.900878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:46.901355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:46.901839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:46.902514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:46.902963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:46.903383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:47.028488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:47.035886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90e77401-ced2-48e2-b92d-ef2b83268a0c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.144629 Aug 08 17:32:47.036450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1775/3096] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:46 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:47.883510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:47.884148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:47.891066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:47.891548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:47.891990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:47.892671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:47.893128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:47.893553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:48.023729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:48.031731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1c4c60a4-98e2-4950-8145-f585015ad240 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152117 Aug 08 17:32:48.032335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1776/3097] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:48.056123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:48.057379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:48.063220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:48.063699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:48.064134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:48.064809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:48.065260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:48.065681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:48.195933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:48.204199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db1d6d14-e5bc-4f29-8ac9-345879a5bcfc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.151684 Aug 08 17:32:48.204797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1777/3098] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:48 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:48.258358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfd5df8-916a-4085-93d4-26fa2756ce2f", "name": "network-vif-plugged", "status": "completed", "tag": "a3cb8f55-9a30-4b1d-b100-97cd3ada14e8"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:48.267698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:48.268321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:48.268615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:48.279850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] Creating event network-vif-plugged:a3cb8f55-9a30-4b1d-b100-97cd3ada14e8 for instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f on hv-cinder-85221 Aug 08 17:32:48.284792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-26fcd6f8-0e4a-4740-9e18-d5fa2fc82225 req-7e0f909c-d2f1-44e0-b893-dfb451ced662 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078895 Aug 08 17:32:48.285551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1778/3099] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:32:49.049627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.050474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=12 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.054947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:49.055643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:49.062332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:49.062820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:49.063262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:49.063946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:49.064404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:49.064831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:49.195075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:49.203674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-af94180a-ad84-49f7-b3bb-7a25b8643247 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154990 Aug 08 17:32:49.204313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1779/3100] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:49 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:49.225686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:49.226437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:49.232362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:49.232846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:49.233285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:49.234008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:49.234471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:49.234899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:49.363754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:49.371661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cc036801-2e00-4691-af08-7f8b59a4399f tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.149516 Aug 08 17:32:49.372217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1780/3101] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:49 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:50.224325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:50.225026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:50.231776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:50.232515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:50.232949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:50.233623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:50.234095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:50.234516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:50.365139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:50.373170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8656d79f-663d-41bd-afc0-09e48435d0cd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152698 Aug 08 17:32:50.377022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1781/3102] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:50.391465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:50.392072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:50.397946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:50.398432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:50.398872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:50.399593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:50.400549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:50.400984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:50.535057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:50.542527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4c870dec-2b97-49d4-abf9-6f4b2bae6e8c tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1365 microversion: 2.1 time: 0.154535 Aug 08 17:32:50.554001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1782/3103] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:50 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:51.394105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:51.394782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:51.401196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.401677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.402145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.402834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.403288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.403743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.528961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:51.536775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5058d68c-9859-49b0-ba4d-4bd192aa9d47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146505 Aug 08 17:32:51.537335 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1783/3104] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:51.562766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:51.563375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:51.569115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.569597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.570072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.570758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.571209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.571639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.701162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:51.704509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.708727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53efb7c5-cd5a-43e6-816f-64e47686cce4 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1554 microversion: 2.1 time: 0.149535 Aug 08 17:32:51.709282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1784/3105] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:51 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:51.730145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:51.730776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:51.737380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.737901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.738336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.739016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:51.739466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:51.739884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:51.814218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-183437ff-e8cd-4e6d-a0a7-8c6490cd8d2a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088886 Aug 08 17:32:51.814828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1785/3106] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:32:51 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:32:52.559416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:52.560093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:52.566268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:52.566758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:52.567191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:52.571367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:52.571367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:52.571367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:52.930737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:52.940636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-04f0384d-502a-4da8-a977-a8bd1031ed11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.386284 Aug 08 17:32:52.941232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1786/3107] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:53.137461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfd5df8-916a-4085-93d4-26fa2756ce2f", "tag": "a3cb8f55-9a30-4b1d-b100-97cd3ada14e8"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:32:53.146799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:53.147279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:53.147705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:53.159399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] Creating event network-changed:a3cb8f55-9a30-4b1d-b100-97cd3ada14e8 for instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f on hv-cinder-85221 Aug 08 17:32:53.164389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-2ae83b63-a6eb-44bc-a728-f382fea42d1b req-d03cff0e-e58f-43f8-9f8a-daa516fb4bfe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078989 Aug 08 17:32:53.164967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1787/3108] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:32:53.963687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:53.965115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:53.971678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:53.972161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:53.972596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:53.973291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:53.973856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:53.974285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:54.104968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:54.113305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-25fd1e24-3b84-4130-9b80-47a02904fbdc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154425 Aug 08 17:32:54.114015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1788/3109] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:55.135139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:55.135857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:55.142088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:55.142561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:55.142991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:55.143667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:55.144115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:55.144531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:55.272657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:55.281150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-13e6050b-f980-49ac-bae1-a7a506f65a55 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150386 Aug 08 17:32:55.281707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1789/3110] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:56.302456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:56.303092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:56.309603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:56.310117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:56.310579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:56.311268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:56.311719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:56.312152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:56.438052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:56.446019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c3df5ae6-97c4-488c-b1fb-ee63f0be3d9a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147481 Aug 08 17:32:56.446580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1790/3111] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:56 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:57.466637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:57.467315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:57.473662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:57.474174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:57.474612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:57.475298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:57.475751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:57.476177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:57.605066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:57.613221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-be5084f1-548b-4454-a69e-29b0fdad84c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150481 Aug 08 17:32:57.613780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1791/3112] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:58.635235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:58.635845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:58.642203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:58.642679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:58.643112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:58.643786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:58.644234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:58.644653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:58.769680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:58.777530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fbd94233-2b7b-42d9-a4a8-5211118dfd66 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146722 Aug 08 17:32:58.778122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1792/3113] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:59.798885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:32:59.799558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:32:59.806005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:59.813196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:59.813196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:59.813196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:32:59.813196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:32:59.813632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:32:59.936745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:32:59.944620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2053d0c5-3ce8-47e0-96b3-f7fb815dd6a9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149614 Aug 08 17:32:59.945183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1793/3114] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:32:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:00.966699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:00.967355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:00.973695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:00.974214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:00.974651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:00.975332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:00.975786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:00.976212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:01.104566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:01.112685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-186e551b-3f19-4805-8fba-07f3c5a17a31 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150462 Aug 08 17:33:01.113256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1794/3115] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:02.133718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:02.139420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:02.140774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:02.141603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:02.142073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:02.142751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:02.143455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:02.143878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:02.273606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:02.283862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41d3c4a1-5dab-4c35-82d6-9c0042cac9f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154121 Aug 08 17:33:02.284422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1795/3116] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:03.306759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:03.307449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:03.313752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:03.314260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:03.314695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:03.315379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:03.315957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:03.316328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:03.446694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:03.462786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c2effdf8-2849-4a3d-b5bd-d51cb945b41c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.159257 Aug 08 17:33:03.463671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1796/3117] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:03 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:04.484376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:04.485005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:04.491433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:04.491916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:04.492353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:04.493045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:04.493502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:04.493959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:04.623384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:04.632870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5b09494f-87c0-41fe-947b-958b13c32495 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152710 Aug 08 17:33:04.633438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1797/3118] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:05.655968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:05.657155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:05.667486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:05.668143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:05.668774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:05.669720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:05.670317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:05.670816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:05.803668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:05.811622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-52d25131-82a3-47ea-9e1f-e7d39da5352b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.161058 Aug 08 17:33:05.812187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1798/3119] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:06.832964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:06.833601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:06.839854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:06.840333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:06.840801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:06.841478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:06.841963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:06.842388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:06.967816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:06.975583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-438edb1d-c09e-4da4-92ca-028d5be23549 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146499 Aug 08 17:33:06.976185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1799/3120] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:07.997280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:07.997968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:08.004419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:08.004898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:08.005332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:08.006049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:08.006509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:08.006936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:08.132971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:08.141456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21de84a5-4b58-4d01-b8db-0d993ab235b1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148069 Aug 08 17:33:08.142043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1800/3121] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:09.162537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:09.163204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:09.166182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.170797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:09.171276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:09.171711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:09.172388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:09.172867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:09.173285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:09.303392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:09.311204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f08199e9-ca3a-41d5-815e-fd792b096b09 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152516 Aug 08 17:33:09.311765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1801/3122] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:10.332518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:10.333184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:10.340367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:10.340847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:10.341289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:10.341997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:10.342453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:10.342884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:10.361045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.470521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:10.478640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fceb8270-5c13-4ddb-8f5c-64f041763522 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150074 Aug 08 17:33:10.479194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1802/3123] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:10 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:11.500189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:11.500898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:11.507145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:11.507625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:11.508054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:11.508728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:11.509178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:11.509602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:11.638224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:11.646305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-52928af0-892f-4bfe-985b-850ff926f442 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150006 Aug 08 17:33:11.646878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1803/3124] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:12.667418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:12.668030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:12.674483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:12.674962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:12.675390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:12.676100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:12.676549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:12.676971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:12.802199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:12.810508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70215322-4a41-4bb5-a25a-b8a4dfe53378 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147041 Aug 08 17:33:12.811068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1804/3125] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:33:13.831830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:13.832472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:13.838897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:13.839435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:13.839824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:13.840515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:13.840977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:13.841405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:13.968515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:13.976390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0842a711-b1bc-49a3-aeae-ed620bdd7117 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148432 Aug 08 17:33:13.976951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1805/3126] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:14.998588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:14.999240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:15.005484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:15.005998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:15.006432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:15.007103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:15.007551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:15.007974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:15.138902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:15.146831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b5426eb8-3d46-472b-9dc5-ef92dbf152db tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152638 Aug 08 17:33:15.147391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1806/3127] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:16.167960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:16.168615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:16.174979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:16.175460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:16.175894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:16.176574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:16.177028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:16.177452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:16.301886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:16.309768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cd2644cf-1a39-4ae4-80b4-aa48a47c27e1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.145681 Aug 08 17:33:16.310348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1807/3128] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:17.331176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:17.331865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:17.338285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:17.338762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:17.339193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:17.339875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:17.340320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:17.340737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:17.469432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:17.477310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-27647de3-4329-43ad-ad9c-2936f27bd0d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150019 Aug 08 17:33:17.477892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1808/3129] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:17 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:18.499869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:18.500555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:18.507028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:18.507516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:18.507950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:18.508627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:18.509075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:18.509499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:18.635813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:18.643573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59a71860-3922-4230-84ba-24c5096eced1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147488 Aug 08 17:33:18.644136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1809/3130] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:19.665610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:19.666254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:19.672599 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:19.673075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:19.673509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:19.674217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:19.674669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:19.675108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:19.804265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:19.812663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5908e926-51a5-4fe0-8969-b1e8f21bc290 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150962 Aug 08 17:33:19.813218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1810/3131] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:20.832825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:20.833464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:20.840526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:20.846017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:20.846017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:20.846017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:20.846017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:20.846444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:20.978074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:20.986228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b14e93a-6a4e-4e19-9cda-e543c32f0853 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157358 Aug 08 17:33:20.986792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1811/3132] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:22.008192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:22.008868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:22.015841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:22.016326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:22.016764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:22.017453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:22.017943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:22.018386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:22.150612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:22.158503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e927db5c-fbf6-4d69-bb87-f9695859e74b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154313 Aug 08 17:33:22.159266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1812/3133] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:23.179064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:23.179738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:23.186077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:23.186552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:23.186981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:23.187653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:23.188102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:23.188521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:23.323172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:23.331110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aeb77c65-5ccf-44ad-9870-d82ad3c02cc2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155877 Aug 08 17:33:23.331679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1813/3134] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:24.352520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:24.353698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:24.360431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:24.360915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:24.361353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:24.362066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:24.362519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:24.362944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:24.489084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:24.497836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ee26f48f-55fe-4c04-9bf6-9166a6fdae3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149177 Aug 08 17:33:24.498408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1814/3135] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:24 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:25.518763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:25.519441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:25.526326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:25.526813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:25.527271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:25.527958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:25.528418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:25.528849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:25.659504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:25.668039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9f0ad66f-052a-4ad7-aa3d-e86872a2a6e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153222 Aug 08 17:33:25.668606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1815/3136] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:26.688320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:26.688950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:26.695288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:26.695765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:26.696197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:26.696867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:26.697315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:26.697732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:26.823989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:26.832006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-08383d76-1cd8-49a9-91f7-438b64823347 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147488 Aug 08 17:33:26.832671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1816/3137] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:27.853711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:27.854377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:27.860962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:27.861442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:27.861899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:27.862577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:27.863025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:27.863448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:27.991010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:27.999872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5571a3d5-e5f7-472d-a6c9-3d88710c16c7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150081 Aug 08 17:33:28.000436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1817/3138] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:29.020933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:29.021590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:29.028467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:29.028945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:29.029378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:29.030078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:29.030526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:29.030945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:29.161732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:29.169558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4352e056-84c6-484b-9723-153fa3ede20a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152468 Aug 08 17:33:29.170144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1818/3139] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:29.379864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:29.380355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:29.386827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:29.387306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:29.387735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:29.388406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:29.388848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:29.389276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:29.392768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.411279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7625a005-c410-4d07-bb00-82eb7056fee7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035266 Aug 08 17:33:29.417936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1819/3140] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:33:29 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:33:30.191053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:30.191687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:30.198931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:30.199416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:30.199856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:30.200545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:30.201002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:30.201454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:30.331300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:30.340088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-32dedb27-99f8-4fec-b6b2-147f5c76dc44 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152933 Aug 08 17:33:30.340975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1820/3141] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:31.362096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:31.362693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:31.369246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:31.369763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:31.370240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:31.370926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:31.371383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:31.371812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:31.500891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:31.508880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-694d5ccb-9207-468b-94fc-5c51b674147e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150776 Aug 08 17:33:31.509440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1821/3142] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:31 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:32.529472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:32.530179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:32.536561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:32.537039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:32.537480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:32.538216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:32.538679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:32.539110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:32.669540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:32.677592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19aa98bd-26ae-4838-b0fe-12005d2fc450 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151966 Aug 08 17:33:32.678247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1822/3143] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:33.700664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:33.701518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:33.709693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:33.710213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:33.710652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:33.711337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:33.711792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:33.712220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:33.841146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:33.848945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-34dd4474-d7cc-44c2-852c-ebcdde3d8ef8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152630 Aug 08 17:33:33.849509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1823/3144] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:33:34.870265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:34.870897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:34.877200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:34.877685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:34.878158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:34.878845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:34.879312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:34.879720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:35.005600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:35.013975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b26f572f-3dd7-42bc-b9b3-e265c047f280 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147523 Aug 08 17:33:35.014537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1824/3145] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:36.035107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:36.035782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:36.042685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:36.043167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:36.043600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:36.044278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:36.044730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:36.045154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:36.173338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:36.181277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2871db11-c7a4-47ac-b37d-184e354308e3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150008 Aug 08 17:33:36.181855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1825/3146] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:37.202039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:37.202642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:37.208979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:37.209461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:37.209938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:37.210624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:37.211077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:37.211502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:37.343262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:37.351125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38fe0c36-bfb6-4fc2-9ee4-695190d70a0c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153012 Aug 08 17:33:37.351683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1826/3147] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:38.373224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:38.373906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:38.380203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:38.380680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:38.381112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:38.381822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:38.382270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:38.382689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:38.509873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:38.517671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-478cedca-a69e-4127-b771-ec7e6bd0a839 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148255 Aug 08 17:33:38.518262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1827/3148] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:39.539074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:39.540252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:39.542473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=54 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.547054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:39.547526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:39.547958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:39.548628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:39.549072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:39.549488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:39.679403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:39.687305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-773104a4-579c-4af1-926c-07fb50ca61a2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152116 Aug 08 17:33:39.687869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1828/3149] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:40.708442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:40.709051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:40.715357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:40.715832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:40.716261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:40.716934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:40.717380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:40.717813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:40.845426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:40.853910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-be947c36-3417-4738-a0af-62022ddc58f8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149322 Aug 08 17:33:40.854473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1829/3150] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:41.603044 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:33:41.603557 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:33:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:33:41.875048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:41.875573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:41.881998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:41.882478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:41.882909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:41.884217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:41.884667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:41.885092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:42.010530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:42.018259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70fc9254-4cfc-43ed-9919-1ea0c070020a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147225 Aug 08 17:33:42.018822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1830/3151] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:43.039419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:43.040597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:43.046985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:43.047473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:43.047914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:43.048602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:43.049062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:43.049486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:43.179787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:43.188317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11e6b66b-b87c-4797-a82d-d98afac180f3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152891 Aug 08 17:33:43.188880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1831/3152] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:44.209241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:44.209940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:44.216293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:44.216773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:44.217208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:44.217922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:44.218376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:44.218798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:44.347970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:44.356221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-62a07d85-4a98-410e-b8c1-53db982cd85e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150791 Aug 08 17:33:44.359169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1832/3153] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:45.378199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:45.378885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:45.385715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:45.386227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:45.386659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:45.387339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:45.387788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:45.388209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:45.462468 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:33:45.463034 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:33:45.520458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:45.528983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3960d72-7532-490b-99b5-71bcb893ef11 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155011 Aug 08 17:33:45.529538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1833/3154] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:46.549866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:46.550556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:46.556616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:46.557090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:46.557517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:46.558225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:46.558673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:46.559095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:46.687219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:46.695104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c76577e-ee94-4a40-ae9a-186efd4ea4da tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149118 Aug 08 17:33:46.696163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1834/3155] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:47.717076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:47.717682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:47.724140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:47.724623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:47.725061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:47.725744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:47.726293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:47.726720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:47.855839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:47.863688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-859df25e-756e-4f88-ae38-e6e2ef4aa76a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150457 Aug 08 17:33:47.864240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1835/3156] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:48.884648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:48.885318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:48.891645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:48.892126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:48.892563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:48.893243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:48.893696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:48.894147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:48.898078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:49.020289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:49.028746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e8304d1-c7d4-46a2-bc3a-7a2c79e747c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147890 Aug 08 17:33:49.029311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1836/3157] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:50.050207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:50.050852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:50.057867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:50.058353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:50.058793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:50.059473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:50.059930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:50.060353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:50.186995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:50.194730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-49adf9e3-fc32-4e65-a9e5-4fc2f94cf22e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148349 Aug 08 17:33:50.195287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1837/3158] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:51.215355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:51.215960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:51.222339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:51.222822 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:51.223258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:51.223938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:51.224392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:51.224815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:51.354815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:51.362672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-91ad892d-81d9-41a9-9596-aa9c6c8634a3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151177 Aug 08 17:33:51.363233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1838/3159] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:52.384123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:52.384731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:52.391269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:52.391753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:52.392193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:52.392876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:52.393411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:52.393861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:52.521338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:52.529151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b730903-51f8-4799-9482-7dbc65751860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149513 Aug 08 17:33:52.529716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1839/3160] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:53.549316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:53.549997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:53.557124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:53.557602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:53.558067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:53.558755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:53.559209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:53.559633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:53.688402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:53.696485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f776e48c-0269-4d61-a544-8727010c4af2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151010 Aug 08 17:33:53.697063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1840/3161] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:54.716393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:54.717032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:54.723447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:54.723926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:54.724359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:54.725037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:54.725488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:54.725940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:54.850639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:54.858631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a9c29211-4e1b-4045-9e53-92663c2dd515 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146106 Aug 08 17:33:54.859185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1841/3162] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:55.879921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:55.880579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:55.887408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:55.887884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:55.888315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:55.888990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:55.889440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:55.889880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:56.015803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:56.024456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6807f9b6-7ffd-4283-bdf6-0d8a31805225 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148420 Aug 08 17:33:56.025012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1842/3163] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:57.045955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:57.046587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:57.052975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:57.053458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:57.053936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:57.054620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:57.055076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:57.055501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:57.184087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:57.192049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-531225fd-96a4-429b-bbc5-793adcce2036 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149939 Aug 08 17:33:57.192613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1843/3164] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:58.213800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:58.214468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:58.220804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:58.221282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:58.221713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:58.222483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:58.222931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:58.223352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:58.348893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:58.357744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6393627-0cc7-403b-bb99-d38842570070 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148328 Aug 08 17:33:58.358343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1844/3165] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:33:59.379494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:33:59.380153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:33:59.387183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:59.387668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:59.388107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:59.388798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:33:59.389256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:33:59.389684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:33:59.520926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:33:59.528873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bae81cfd-8338-4c0f-b3e3-3e047bc32f87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153223 Aug 08 17:33:59.529439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1845/3166] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:33:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:34:00.550412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:00.551080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:00.558177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:00.558990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:00.559111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:00.559782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:00.560228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:00.560649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:00.694450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:00.702857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ab2c470-e265-4550-81de-bc5c80d3d947 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.156295 Aug 08 17:34:00.703414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1846/3167] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:01.723768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:01.724405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:01.731562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:01.732041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:01.732473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:01.733151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:01.733600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:01.734055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:01.864013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:01.873343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6c36ac04-ae9e-4ccb-b6cf-6b59582fd8ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153433 Aug 08 17:34:01.873923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1847/3168] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:02.894264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:02.894886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:02.901196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:02.901676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:02.902138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:02.902815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:02.903264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:02.903686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:03.028208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:03.036005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dbd7e5ed-9701-43d5-b239-c43009238af9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.145671 Aug 08 17:34:03.036552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1848/3169] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:04.056031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:04.056799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:04.063112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:04.063593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:04.064029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:04.064711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:04.065162 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:04.065587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:04.191292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:04.199574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0ff4db2e-7245-4115-b518-33b8eefa529e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147398 Aug 08 17:34:04.200167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1849/3170] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:05.221041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:05.221723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:05.228940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:05.229417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:05.229943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:05.230626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:05.231073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:05.231494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:05.360042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:05.367875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0cbbe2d3-32f3-4cf2-9357-366d08893695 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150693 Aug 08 17:34:05.368438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1850/3171] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:06.388392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:06.389060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:06.395725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:06.396292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:06.396731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:06.397442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:06.397940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:06.398362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:06.522860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:06.530570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-779c3b5c-93a7-44f4-8997-a240e9791d1f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146030 Aug 08 17:34:06.531129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1851/3172] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:07.551862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:07.552469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:07.559285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:07.559761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:07.560194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:07.560866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:07.561312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:07.561731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:07.693007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:07.696417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:07.701076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-233e8751-bbfd-4bf9-8fcd-305571a112d4 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153048 Aug 08 17:34:07.701626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1852/3173] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:08.722222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:08.722820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:08.730234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:08.730720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:08.731161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:08.731848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:08.732303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:08.732732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:08.859966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:08.867879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63762c9a-5216-4a05-bd58-69da0e657729 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149822 Aug 08 17:34:08.868439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1853/3174] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:09.889011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:09.889609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:09.891835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=52 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:09.896470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:09.896981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:09.897421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:09.898130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:09.898585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:09.899011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:10.025417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:10.033233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad700775-30f7-4101-9fb0-41b54005821f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148144 Aug 08 17:34:10.033808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1854/3175] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:11.054664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:11.055831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:11.062156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:11.062640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:11.063079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:11.063761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:11.064221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:11.064648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:11.192191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:11.200654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-041e6556-6234-4ed1-a335-7469c0ef2c0e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149793 Aug 08 17:34:11.201208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1855/3176] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:12.221522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:12.222274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:12.229090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:12.229564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:12.230021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:12.230699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:12.231144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:12.231558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:12.357970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:12.365744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30c147eb-157e-4449-8a02-771da054e15e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148032 Aug 08 17:34:12.366319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1856/3177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:13.387237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:13.387910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:13.394371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:13.394853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:13.395299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:13.395980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:13.396435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:13.396860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:13.525882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:13.533696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-07b5c9e5-890d-40db-82ed-00259176ccf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150924 Aug 08 17:34:13.534286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1857/3178] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:14.554813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:14.555433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:14.561962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:14.562450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:14.562889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:14.563571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:14.564021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:14.564468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:14.692941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:14.701453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e3e2d0b0-db3c-4348-bef1-ae60d7a5918b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150459 Aug 08 17:34:14.702060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1858/3179] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:15.724163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:15.724789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:15.732060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:15.732536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:15.732976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:15.733648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:15.734133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:15.734552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:15.862816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:15.870780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6cc9b1cb-2e22-4749-b217-fde32a1ea9be tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150456 Aug 08 17:34:15.871330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1859/3180] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:16.891736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:16.892379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:16.898623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:16.899104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:16.899540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:16.900324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:16.900853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:16.901278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:17.026992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:17.034890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce41e086-808b-4450-bcba-a8f613c2895c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147106 Aug 08 17:34:17.035445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1860/3181] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:18.056533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:18.057199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:18.063495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:18.063979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:18.064417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:18.065101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:18.065557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:18.066013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:18.192358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:18.200777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81e548cd-1884-4915-8cb3-984ffe916cf6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148106 Aug 08 17:34:18.201339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1861/3182] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:19.222387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:19.223115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:19.229737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:19.230278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:19.230712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:19.231385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:19.231875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:19.232296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:19.361086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:19.369525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ada43b00-3a72-4dc8-800f-3afc77a84b28 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150938 Aug 08 17:34:19.375604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1862/3183] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:20.391229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:20.391881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:20.398825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:20.399328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:20.399798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:20.400473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:20.400921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:20.401338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:20.529046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:20.537044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e4f76d72-488d-4e64-8c84-dc027b80b3ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149810 Aug 08 17:34:20.537603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1863/3184] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:21.557561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:21.558297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:21.564617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:21.565096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:21.565527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:21.566241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:21.566691 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:21.567108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:21.699656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:21.707631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f36055b4-f473-4515-a777-89b70a27fa67 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154449 Aug 08 17:34:21.708186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1864/3185] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:22.730006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:22.730662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:22.736873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:22.737354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:22.737805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:22.738480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:22.738927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:22.739345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:22.866377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:22.874834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40fb918a-720b-43ec-b1a5-52667676b84a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149431 Aug 08 17:34:22.875388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1865/3186] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:23.895878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:23.896494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:23.902866 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:23.903346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:23.903856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:23.904535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:23.904985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:23.905404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:24.028682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:24.036403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3feaa27c-b17a-4b03-a02f-163725023bc0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.144444 Aug 08 17:34:24.036961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1866/3187] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:25.057915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:25.058594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:25.064908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:25.065394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:25.065854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:25.066542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:25.067000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:25.067430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:25.197462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:25.205264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ab4f015d-9591-4544-8391-6e33ec743832 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151829 Aug 08 17:34:25.205840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1867/3188] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:26.226192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:26.226878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:26.233524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:26.234034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:26.234488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:26.235163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:26.235611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:26.236029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:26.360480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:26.368754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-32f82a0d-0fea-4da6-9a81-fa55177af377 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146441 Aug 08 17:34:26.369309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1868/3189] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:27.390706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:27.391351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:27.398460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:27.398950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:27.399390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:27.400078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:27.400535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:27.400959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:27.418640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:27.531940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:27.539733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e9c7abc-b8ac-41ad-a6f9-6b6d75a66df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152892 Aug 08 17:34:27.540285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1869/3190] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:28.560911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:28.561603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:28.567893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:28.568370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:28.568804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:28.569479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:28.569955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:28.570390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:28.697990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:28.705410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-217358a8-acdf-47be-a665-1bb24667cc4a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148449 Aug 08 17:34:28.705989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1870/3191] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:29.727078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:29.728053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:29.734600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:29.735084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:29.735520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:29.736201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:29.736654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:29.737084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:29.868109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:29.875990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-69084fe8-2582-4800-854d-c1d1ec68b0f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152763 Aug 08 17:34:29.876555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1871/3192] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:30.897078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:30.898274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:30.904583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:30.905067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:30.905504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:30.906243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:30.906681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:30.907105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:31.033916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:31.041751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fdd47ad1-ba65-4b8d-9a6e-a12146d822ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148580 Aug 08 17:34:31.042333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1872/3193] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:32.061655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:32.062342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:32.068668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:32.069150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:32.069587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:32.070300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:32.070755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:32.071179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:32.203932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:32.211992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-435051bd-257e-4c09-8a10-28e62d008d70 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.154161 Aug 08 17:34:32.212546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1873/3194] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:33.233659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:33.234351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:33.240669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:33.241146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:33.241575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:33.242865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:33.243312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:33.243734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:33.372724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:33.380563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ec86ffbb-2d5c-4167-a9c9-f3c72637aa53 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150767 Aug 08 17:34:33.381123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1874/3195] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:34.400738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:34.403806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:34.407988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:34.408475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:34.408921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:34.409613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:34.410097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:34.410530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:34.538198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:34.546548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-984aab5b-16f8-46a5-b54f-6f7f9b35af6d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149916 Aug 08 17:34:34.547119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1875/3196] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:35.567579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:35.568291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:35.575069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:35.575548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:35.575984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:35.576663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:35.577110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:35.577532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:35.707185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:35.715688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dd3210e2-cf11-4590-a306-6fe12870f100 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151981 Aug 08 17:34:35.716250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1876/3197] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:36.737146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:36.737813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:36.744200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:36.744680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:36.745114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:36.745818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:36.746276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:36.746702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:36.871939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:36.879862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d52e884-63c2-46fb-a75e-6487a921c309 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146572 Aug 08 17:34:36.880429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1877/3198] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:37.595012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:37.595512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:37.601422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.601940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.602630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:37.603897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.604344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.604763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:37.617764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] HTTP exception thrown: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Request method failure captured: Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea HTTP/1.1 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEklXc14OY0-E2ExT5BHrA68F7OOToFPfZVM_3KFwr0icJg8pDQ02uiDcJvrSjqOzqhJtxkgnSsPPTkefbnUkX7Eb0nGRJZqA_jkpRrcuggVR3_XCImNUmI8xC8X52G4Wrd7j5OFbXL0KgI442Lcv7u0WKSgCfnJBJoy_-ZjPy_GEg Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:34:37.620090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3b8ed5fb092140a1a4e9ae005f3c8973", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 60dc4976d686449f80d3bfad387a2406 Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.621680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea'} Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:34:37.625421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.627506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.629719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Returning 404 to user: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:34:37.629719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed0595ae-7add-419a-8c01-7842e7585129 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 404 len: 111 microversion: 2.20 time: 0.030400 Aug 08 17:34:37.629719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1878/3199] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Aug 8 17:34:37 2022] DELETE /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 17:34:37.629719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:37.630092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] [instance: 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:37.635648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.636130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.636562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:37.637239 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.637688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.638136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:37.653736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] HTTP exception thrown: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Request method failure captured: Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea HTTP/1.1 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEklXc14OY0-E2ExT5BHrA68F7OOToFPfZVM_3KFwr0icJg8pDQ02uiDcJvrSjqOzqhJtxkgnSsPPTkefbnUkX7Eb0nGRJZqA_jkpRrcuggVR3_XCImNUmI8xC8X52G4Wrd7j5OFbXL0KgI442Lcv7u0WKSgCfnJBJoy_-ZjPy_GEg Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:34:37.655276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3b8ed5fb092140a1a4e9ae005f3c8973", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3b8ed5fb092140a1a4e9ae005f3c8973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 3b8ed5fb092140a1a4e9ae005f3c8973 Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-420964821 Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 60dc4976d686449f80d3bfad387a2406 Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeShelveTestJSON-420964821-project Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.657098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea'} Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:34:37.658098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. Aug 08 17:34:37.659716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:34:37.661287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] Returning 404 to user: Instance 1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:34:37.661287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eadb5779-a7d7-44ec-b4f1-fe8a998bcd94 tempest-AttachVolumeShelveTestJSON-420964821 tempest-AttachVolumeShelveTestJSON-420964821-project] 10.222.0.57 "GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea" status: 404 len: 111 microversion: 2.20 time: 0.030896 Aug 08 17:34:37.661287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1879/3200] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Aug 8 17:34:37 2022] GET /compute/v2.1/servers/1f67c3c7-d745-4d1b-bb09-5e6dcd6e61ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:34:37.900477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:37.901158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:37.907480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.907962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.908400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:37.909088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:37.909542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:37.910001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:38.344810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:38.353627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe6c34e8-377d-460a-8a16-af7e97cfa836 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.456471 Aug 08 17:34:38.354233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1880/3201] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:39.375420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:39.376047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:39.382511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:39.383003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:39.383443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:39.384139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:39.384592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:39.385026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:39.540022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:39.549131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-28c1363e-8468-4b87-b393-a893356cee99 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.177641 Aug 08 17:34:39.549858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1881/3202] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:40.573287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:40.573287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:40.575051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:40.579831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:40.580350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:40.580786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:40.581474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:40.581955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:40.582411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:40.713153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:40.722206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d74c7c13-ef4e-4422-8c19-4bd30265bfd8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.155580 Aug 08 17:34:40.723313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1882/3203] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:41.744648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:41.745286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:41.751990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:41.752493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:41.752934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:41.753675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:41.754352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:41.754784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:41.974761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:41.983036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f390e726-2f59-4aac-9bc3-179d07a1e5c9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.242845 Aug 08 17:34:41.986505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1883/3204] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:43.004223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:43.004872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:43.011683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:43.012144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:43.012580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:43.013262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:43.013709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:43.014154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:43.146705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:43.153390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e4f47cb-e701-446a-88d9-80eafd9b364d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152813 Aug 08 17:34:43.153969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1884/3205] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:42 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:44.174419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:44.175061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:44.181426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:44.181944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:44.182383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:44.183069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:44.183525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:44.183953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:44.313630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:44.321508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-249cdb32-56ec-4351-a864-e10127960bc9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150961 Aug 08 17:34:44.322117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1885/3206] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:45.343135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:45.343817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:45.350361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:45.350840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:45.351273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:45.352207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:45.353138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:45.353558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:45.481263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:45.489234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-af99bd52-e9d7-4fdc-b113-861212981ab2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149958 Aug 08 17:34:45.489872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1886/3207] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:46.513140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:46.513878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:46.519847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:46.520337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:46.520776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:46.521465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:46.521967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:46.522398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:46.540069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:46.650061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:46.657842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed3e2c8c-73d1-4010-aba8-c0332f35f360 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150181 Aug 08 17:34:46.658394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1887/3208] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:47.679168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:47.679775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:47.686236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:47.686710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:47.687141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:47.687813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:47.688259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:47.688676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:47.819493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:47.827961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6dafb9e5-1b5f-403d-a083-873c081a50ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152612 Aug 08 17:34:47.828528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1888/3209] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:48.848813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:48.849490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:48.856676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:48.857155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:48.857591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:48.858301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:48.858755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:48.859179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:48.983607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:48.991337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7e333e9b-1b53-4a29-bef7-3954a1a5fdc6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146398 Aug 08 17:34:48.991897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1889/3210] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:50.011998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:50.012618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:50.019029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:50.019515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:50.019957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:50.020645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:50.021105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:50.021533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:50.150574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:50.158641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f610e820-76f9-45ad-993a-b07891c1a935 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150489 Aug 08 17:34:50.159209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1890/3211] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:51.181015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:51.181645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:51.188225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:51.188701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:51.189163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:51.189881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:51.190331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:51.190748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:51.316811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:51.324711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2f0e9a9-1f3b-4e15-b623-8a3974d48ed2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148242 Aug 08 17:34:51.325276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1891/3212] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:52.345550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:52.346230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:52.353052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:52.353540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:52.354094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:52.354783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:52.355236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:52.355663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:52.484340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:52.492133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1aae43a1-4bb5-4ddc-a010-a920fc80b722 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150558 Aug 08 17:34:52.493203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1892/3213] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:53.513362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:53.514042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:53.520420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:53.520896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:53.521326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:53.522032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:53.522484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:53.522902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:53.653245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:53.661067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38aadd3c-1eae-4d97-88b4-3b85ab8c3860 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151592 Aug 08 17:34:53.661621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1893/3214] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:54.683088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:54.683720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:54.690002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:54.690483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:54.690923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:54.691605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:54.692060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:54.692501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:54.819166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:54.827573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-78823142-b9f2-4ee4-bc35-11e1b6df56ca tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148947 Aug 08 17:34:54.828130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1894/3215] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:55.849501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:55.850173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:55.856889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:55.857378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:55.857840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:55.858534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:55.858994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:55.859423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:55.989419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:55.998148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9c4eac7d-9b62-4fce-a431-9018f6a97e04 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152521 Aug 08 17:34:55.998709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1895/3216] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:57.019024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:57.019646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:57.026045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:57.026523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:57.026955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:57.027632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:57.028081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:57.028504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:57.153629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:57.161520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dff97a78-2aba-4fa9-bc0b-1573f936f475 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146372 Aug 08 17:34:57.162108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1896/3217] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:58.182337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:58.183331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:58.189538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:58.190054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:58.190489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:58.191170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:58.191621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:58.192041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:58.321586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:58.329584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77bda1b8-c155-4252-a439-640ae13ab97f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151214 Aug 08 17:34:58.330172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1897/3218] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:34:59.350864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:34:59.352294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:34:59.358665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:59.359144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:59.359575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:59.360260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:34:59.360712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:34:59.361134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:34:59.486548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:34:59.495004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5befcbc2-0b69-4b83-8a1a-220e20429968 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147986 Aug 08 17:34:59.495561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1898/3219] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:34:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:00.515893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:00.516538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:00.522800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:00.523278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:00.523712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:00.524388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:00.524838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:00.525265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:00.655732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:00.663820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-73cc6d9c-939f-4342-a279-c7d99eddde50 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151702 Aug 08 17:35:00.664385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1899/3220] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:01.685103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:01.685727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:01.692042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:01.692515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:01.692973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:01.693666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:01.694120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:01.694540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:01.825530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:01.833433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8123ce3d-ecf3-496a-9675-c7805cc3e9a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152191 Aug 08 17:35:01.834028 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1900/3221] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:35:02.854755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:02.855368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:02.861605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:02.862114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:02.862546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:02.863218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:02.863666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:02.864085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:02.989292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:02.997528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-748d070c-ab3c-4fd3-b867-69f0e7b71c2d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147085 Aug 08 17:35:02.998117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1901/3222] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:04.019120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:04.019772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:04.026718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:04.027199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:04.027638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:04.028318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:04.028771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:04.029194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:04.158694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:04.166542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-040ba9fe-c5ad-40f8-932c-b06a2db0bb05 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151290 Aug 08 17:35:04.167140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1902/3223] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:05.187906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:05.188598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:05.194962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:05.195443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:05.195876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:05.196557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:05.197012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:05.197447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:05.323207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:05.331016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-74a0f0e7-b594-4362-8f4e-a1c29c27b487 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146962 Aug 08 17:35:05.331575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1903/3224] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:06.353075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:06.353741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:06.360172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:06.360650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:06.361084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:06.361768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:06.362245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:06.362669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:06.366524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:06.488875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:06.496620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0429d960-259a-4397-bb86-057fbf56c7b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148127 Aug 08 17:35:06.497177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1904/3225] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:07.518242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:07.528532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:07.528532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:07.528532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:07.528532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:07.529117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:07.529117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:07.529117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:07.659377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:07.667903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9f899004-972d-4cda-9add-7439bd9a9ba3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153617 Aug 08 17:35:07.668474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1905/3226] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:08.689282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:08.689983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:08.696808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:08.697286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:08.697718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:08.698469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:08.698924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:08.699350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:08.825767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:08.833560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e2e5bd1-64cb-426b-94f5-6cfec96689b9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148127 Aug 08 17:35:08.834150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1906/3227] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:09.854602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:09.855256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:09.861448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:09.861962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:09.862456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:09.863129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:09.863579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:09.863998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:09.993873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:10.001591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-068503fe-8736-484f-90a4-186ea6c53a2c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151102 Aug 08 17:35:10.002177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1907/3228] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:11.022891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:11.023544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:11.026345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=52 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:11.031006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:11.034557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:11.034557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:11.034557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:11.034557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:11.034969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:11.159707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:11.168170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ba79d80-2439-47a6-bb1e-44fb014c2d2f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149151 Aug 08 17:35:11.168737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1908/3229] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:12.188346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:12.188972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:12.195316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:12.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:12.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:12.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:12.206156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:12.206586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:12.327447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:12.335254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3a497207-c38d-4f15-85cf-f26c0c6c0fe5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150730 Aug 08 17:35:12.335811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1909/3230] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:13.357392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:13.358132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:13.364561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:13.365043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:13.365477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:13.366196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:13.366653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:13.367078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:13.493522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:13.501394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-804ec408-4e0e-4ead-9f3c-69f44fc119ef tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147816 Aug 08 17:35:13.501977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1910/3231] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:14.523283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:14.524025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:14.530825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:14.531303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:14.531736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:14.532411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:14.532861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:14.533281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:14.661521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:14.669454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac863504-1b56-47e6-b8d0-39d2e6642867 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150077 Aug 08 17:35:14.670055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1911/3232] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:15.690403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:15.691016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:15.697496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:15.698011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:15.698449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:15.699131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:15.699586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:15.700009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:15.830641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:15.839259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d34347df-5aaf-408c-a819-a842113262d9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152623 Aug 08 17:35:15.839753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1912/3233] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:16.859825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:16.860450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:16.866533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:16.867008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:16.867438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:16.868715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:16.869166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:16.869588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:16.996631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:17.004588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-47b98679-5d00-4783-b2f5-abf5b6ec33f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148656 Aug 08 17:35:17.005144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1913/3234] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:18.025495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:18.026203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:18.032530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:18.033005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:18.033435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:18.034143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:18.034593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:18.035013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:18.162951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:18.171275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c850ee11-81c4-45b8-a276-af61d52d3b82 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149595 Aug 08 17:35:18.171824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1914/3235] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:19.192727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:19.193427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:19.199734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:19.200210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:19.200640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:19.201319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:19.201765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:19.202206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:19.327222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:19.334995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f8a5d4dc-e6de-4b49-b9ba-38355d86f250 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146110 Aug 08 17:35:19.335557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1915/3236] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:35:19.887108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:35:19.887304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:35:20.357455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:20.363205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:20.364390 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:20.364874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:20.365318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:20.366039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:20.366493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:20.366915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:20.495258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:20.503176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cce38fef-bdb1-4243-b84d-1ba0e96daa3e tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149770 Aug 08 17:35:20.503732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1916/3237] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:35:21.524041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:21.524651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:21.531044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:21.531524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:21.531964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:21.532646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:21.533105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:21.533532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:21.663647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:21.671488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-14444c6d-d136-4e5b-9562-84693ed81f77 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151322 Aug 08 17:35:21.672043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1917/3238] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:22.692422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:22.693080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:22.699959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:22.700472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:22.700914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:22.701603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:22.702088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:22.702518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:22.831989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:22.840607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9542ab87-10c9-49e8-8982-df4f8f5249c6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151968 Aug 08 17:35:22.841111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1918/3239] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:23.862596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:23.863273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:23.869636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:23.870182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:23.870627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:23.871321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:23.871780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:23.872228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:24.003353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:24.011207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d9ff66da-eb06-4a1a-8e34-96fd843613f6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152587 Aug 08 17:35:24.011769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1919/3240] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:24.422024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:35:24.422247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:35:25.032797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:25.033445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:25.040326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:25.040808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:25.041246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:25.041960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:25.042415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:25.042840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:25.167979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:25.171356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:25.176146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-915c113d-6560-4853-a52d-8fa644a91dbd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147223 Aug 08 17:35:25.176702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1920/3241] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:26.199059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:26.199715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:26.206198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:26.206681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:26.207117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:26.207790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:26.208245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:26.208668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:26.336647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:26.344602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce339e34-48dc-4017-b3d2-5539a1c96c00 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150321 Aug 08 17:35:26.345186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1921/3242] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:27.367195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:27.367857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:27.374345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:27.374888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:27.375326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:27.376015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:27.376471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:27.376928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:27.506659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:27.517201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b42ecf6-30f6-4fd9-9a87-ff6ff4761da7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153857 Aug 08 17:35:27.517779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1922/3243] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:28.538178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:28.538928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:28.545840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:28.546316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:28.546745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:28.547421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:28.547867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:28.548288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:28.675228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:28.682984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b540575d-b456-4842-84d7-e699c6479d57 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148655 Aug 08 17:35:28.683539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1923/3244] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:29.704365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:29.704981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:29.711912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:29.712395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:29.712833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:29.713512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:29.714010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:29.714436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:29.843760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:29.852728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b8e112a7-783d-4361-bed6-98f6559bf8b5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152241 Aug 08 17:35:29.853289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1924/3245] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:30.874225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:30.874850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:30.881104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:30.881581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:30.882069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:30.882769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:30.883223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:30.883646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:31.014317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:31.022235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-98f9829b-ae76-4da6-9973-05f90e458df0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151983 Aug 08 17:35:31.022788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1925/3246] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:32.043730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:32.044386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:32.050726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:32.051201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:32.051631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:32.052308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:32.052755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:32.053174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:32.414561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:32.422417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-65df1f38-1686-4794-90fa-e2123d59dd26 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.383114 Aug 08 17:35:32.422972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1926/3247] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:32 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:33.444203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:33.445372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:33.451761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:33.452242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:33.452676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:33.453357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:33.453826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:33.454253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:33.579781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:33.587658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30bb3d1b-450a-4b9d-9040-b53746217bc8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147276 Aug 08 17:35:33.588752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1927/3248] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:33 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:34.609457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:34.610099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:34.616474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:34.617565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:34.618024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:34.618743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:34.619192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:34.619613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:34.749508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:34.757319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1b188bff-8f13-43c5-875c-ebc3aafa690f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152751 Aug 08 17:35:34.757887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1928/3249] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:34 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:35.778038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:35.778651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:35.784996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:35.785484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:35.785952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:35.786639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:35.787092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:35.787520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:35.912109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:35.920057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a8406602-873e-4056-90c3-08b875b93857 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.145896 Aug 08 17:35:35.920618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1929/3250] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:36.941408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:36.942108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:36.948804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:36.949279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:36.949712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:36.950410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:36.950856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:36.951282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:37.078511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:37.086886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-961fb737-dbd0-4a53-afe1-8c58536207f1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149367 Aug 08 17:35:37.087437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1930/3251] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:36 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:38.107999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:38.108601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:38.115086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:38.115565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:38.115999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:38.116676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:38.117126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:38.117548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:38.396216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:38.404739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c28b9832-69b1-484b-86c6-2e1f7158f9d6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.300583 Aug 08 17:35:38.405305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1931/3252] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:38 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:39.425509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:39.426214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:39.433268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:39.433752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:39.434215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:39.434897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:39.435352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:39.435777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:39.564073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:39.572625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c48fe72f-cfd5-4ef7-b8f0-5e176a71ce15 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150899 Aug 08 17:35:39.573189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1932/3253] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:39 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:40.706262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:40.706869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:40.713315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:40.713811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:40.714245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:40.714924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:40.715372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:40.715793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:40.845540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:40.853669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-31b09153-51ca-41a5-b17d-10f7363f4607 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.264971 Aug 08 17:35:40.854256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1933/3254] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:40 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:41.874591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:41.875305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:41.877598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=52 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:41.882241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:41.882727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:41.883168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:41.883858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:41.884319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:41.884746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:42.011830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:42.019546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-76b35ff3-81c3-4cd5-b1f3-1e8b54288401 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148743 Aug 08 17:35:42.027868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1934/3255] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:41 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:43.041148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:43.041873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:43.048080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:43.048555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:43.048988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:43.049665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:43.050138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:43.050558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:43.175686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:43.183957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-70375a2d-632c-4e99-80a8-ed425e743cb8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146651 Aug 08 17:35:43.184513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1935/3256] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:43 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:44.205503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:44.206306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:44.212636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:44.213124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:44.213569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:44.214293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:44.214753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:44.215184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:44.344100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:44.352645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c0ac741-8a4e-4ba9-9673-7bfa1ddb0f06 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150481 Aug 08 17:35:44.353213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1936/3257] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:44 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:45.372949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:45.373595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:45.380025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:45.380513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:45.380951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:45.381631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:45.382112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:45.382538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:45.401202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:45.510809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:45.518787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6b418efb-1823-4a41-b52e-f875c9992bc5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149673 Aug 08 17:35:45.519345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1937/3258] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:45 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:46.539878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:46.540565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:46.546488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:46.546971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:46.547405 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:46.548083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:46.548533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:46.548957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:46.679955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:46.688324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0353e990-c782-4a74-aaf9-d2f365f39339 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152965 Aug 08 17:35:46.688880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1938/3259] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:46 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:47.708628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:47.709259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:47.715575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:47.716334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:47.716769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:47.717464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:47.717914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:47.718336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:47.842912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:47.851011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6eb3b808-3c3a-4e3d-9755-50aaf9dfc544 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146254 Aug 08 17:35:47.851562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1939/3260] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:47 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:48.871920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:48.872521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:48.878978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:48.879462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:48.879900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:48.880579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:48.881038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:48.881463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:49.010728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:49.018664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-637ec795-d755-4212-8a89-34749d837def tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150642 Aug 08 17:35:49.019223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1940/3261] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:48 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:49.423376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:35:49.423621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:35:49.511096 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:35:49.511669 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:35:50.040727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:50.041332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:50.047675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:50.048147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:50.048572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:50.049245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:50.049693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:50.050144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:50.176596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:50.184569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b3f8b03-5ed0-4ca8-8f09-2833ea819bee tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148306 Aug 08 17:35:50.185124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1941/3262] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:50 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:51.205261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:51.205952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:51.212311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:51.212792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:51.213230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:51.213940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:51.214395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:51.214819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:51.340214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:51.348153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-246ff88f-d2cf-436d-a1f7-df2e1d077f47 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146739 Aug 08 17:35:51.348715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1942/3263] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:51 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:52.370967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:52.371683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:52.378199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:52.378684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:52.379125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:52.379816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:52.380275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:52.380704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:52.515636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:52.525120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0189de8-e356-4af4-93b0-fabd21f04adb tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.158341 Aug 08 17:35:52.525709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1943/3264] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:52 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:53.549264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:53.550083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:53.557298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:53.557810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:53.558260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:53.558961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:53.559417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:53.559845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:53.694085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:53.702392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e93bc4bb-2efc-450c-9791-3aa4b520d52d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157045 Aug 08 17:35:53.702948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1944/3265] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:53 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:54.723234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:54.724154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:54.731177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:54.731655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:54.732089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:54.732766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:54.733214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:54.733632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:54.864131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:54.871992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-85249255-3d9d-42cc-9680-3f5a3d4169f7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152621 Aug 08 17:35:54.872541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1945/3266] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:54 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:55.893372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:55.894015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:55.900838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:55.901319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:55.901759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:55.902463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:55.902914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:55.903338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:56.027569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:56.035382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8d29fd08-d19b-4893-bffd-8bb43e8bf5ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.145954 Aug 08 17:35:56.035944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1946/3267] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:55 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:57.056343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:57.056969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:57.063339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:57.063860 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:57.064278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:57.064954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:57.065402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:57.065842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:57.192274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:57.200227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-baf9f07a-d0c5-4fae-9c44-f7cdd64b1461 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148363 Aug 08 17:35:57.200780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1947/3268] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:57 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:58.221149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:58.221828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:58.228558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:58.229041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:58.229477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:58.230206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:58.230659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:58.231084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:58.360382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:58.368852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-741e5bc0-6737-4218-8744-60860da1e23a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151549 Aug 08 17:35:58.369409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1948/3269] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:58 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:35:59.390018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:35:59.390688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:35:59.397234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:59.397719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:59.398198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:59.399554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:35:59.400018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:35:59.400447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:35:59.526194 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:35:59.534049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-300ca6b5-837c-43a8-9d66-70ca3b7f54d0 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147872 Aug 08 17:35:59.534618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1949/3270] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:35:59 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:00.554913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:00.555623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:00.561896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:00.562377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:00.562809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:00.563484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:00.563932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:00.564353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:00.696965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:00.704918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9420b0f-18f8-49c6-ba18-e7a2af66375b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153827 Aug 08 17:36:00.705483 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1950/3271] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:00 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:01.727925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:01.728578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:01.734960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:01.735444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:01.735882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:01.736567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:01.737079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:01.737516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:01.866477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:01.874938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9be06b29-2987-4436-af1c-89a109d577d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152216 Aug 08 17:36:01.875495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1951/3272] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:01 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:36:02.895010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:02.895623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:02.901851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:02.902326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:02.902762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:02.903431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:02.903875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:02.904292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:03.034295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:03.042968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ec48037a-2b98-4a00-a0da-a1dec0a8fdea tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151855 Aug 08 17:36:03.043529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1952/3273] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:02 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:04.064195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:04.064872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:04.072748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:04.073225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:04.074474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:04.075182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:04.076402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:04.076830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:04.203776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:04.211856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d1a8aba2-b9b7-4c79-bfa7-ad25cee20720 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151654 Aug 08 17:36:04.212424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1953/3274] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:04 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:05.232967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:05.233647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:05.239961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:05.240443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:05.240883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:05.241569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:05.242879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:05.243351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:05.247469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:05.369997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:05.377821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc2f6ca9-732f-49c0-ac99-2671832d1a61 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148695 Aug 08 17:36:05.378386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1954/3275] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:05 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:06.399278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:06.399960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:06.406559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:06.407036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:06.407469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:06.408140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:06.408589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:06.409014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:06.538549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:06.546372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-db0b2d87-4998-4994-a4f1-1804b900f8b7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151527 Aug 08 17:36:06.546931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1955/3276] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:06 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:07.567821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:07.568647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:07.574735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:07.575241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:07.575675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:07.576351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:07.576800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:07.577219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:07.705068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:07.713465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5c36e603-e559-438a-a8ea-ab8ea89d2a9b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.149484 Aug 08 17:36:07.714096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1956/3277] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:07 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:08.736297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:08.736954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:08.743413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:08.743893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:08.744330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:08.745013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:08.745465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:08.745921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:08.875923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:08.885337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-00c23743-0540-405e-a9b7-2dd51ab88ed8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152842 Aug 08 17:36:08.885928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1957/3278] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:08 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:09.906258 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:09.906890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:09.913167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:09.913649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:09.914116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:09.914799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:09.915248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:09.915669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:10.044556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:10.052333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf78cfdd-d1a4-4c6d-9851-5b87fb22a85b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150021 Aug 08 17:36:10.052886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1958/3279] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:09 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:11.073379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:11.074057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:11.080391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:11.080871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:11.081307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:11.082017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:11.082472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:11.082897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:11.211447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:11.219883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2dedc1e1-409e-467d-b763-d62c78b18c9f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150370 Aug 08 17:36:11.220442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1959/3280] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:11 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:12.240790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:12.241413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:12.243696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=52 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:12.248310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:12.249251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:12.249707 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:12.250410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:12.250861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:12.251326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:12.382222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:12.390579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aef68490-c1ae-4936-aae5-b45418c09d19 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153636 Aug 08 17:36:12.391136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1960/3281] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:12 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:13.411431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:13.412089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:13.418368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:13.418845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:13.419276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:13.419953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:13.420409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:13.420831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:13.549969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:13.557745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-da43de5d-f5f9-4195-b1eb-87ac41656f60 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150134 Aug 08 17:36:13.558338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1961/3282] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:13 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:14.577966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:14.578648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:14.585054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:14.585533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:14.585992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:14.586682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:14.587132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:14.587557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:14.719153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:14.727308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a83eca7-8652-4472-92cd-699f449f68bd tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.153332 Aug 08 17:36:14.727873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1962/3283] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:14 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:15.749421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:15.750044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:15.756440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:15.756921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:15.757358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:15.758070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:15.758524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:15.758950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:15.883976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:15.891888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21d38b1f-7a46-4aaf-90eb-3837ee13aabc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.146901 Aug 08 17:36:15.892455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1963/3284] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:15 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:16.913230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:16.913881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:16.920228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:16.920718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:16.921161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:16.921886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:16.922346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:16.922777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:17.053471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:17.061926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f123ebeb-c6fb-4843-ae63-d31c6f8407ce tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152769 Aug 08 17:36:17.062493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1964/3285] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:16 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:18.082757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:18.083436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:18.091111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:18.091589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:18.092030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:18.092710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:18.093160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:18.093584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:18.219193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:18.227227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4a5955db-15ff-42bd-b109-c7c5528d2f17 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.148448 Aug 08 17:36:18.227788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1965/3286] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:18 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:19.248567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:19.249246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:19.255518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:19.256449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:19.256884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:19.257561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:19.258043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:19.258467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:19.386414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:19.395176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9c414e1e-b253-4d82-b5aa-9d68b36e27f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.150930 Aug 08 17:36:19.395731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1966/3287] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:19 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:20.416419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:20.420364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:20.423584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:20.424054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:20.424485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:20.425157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:20.425603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:20.426048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:20.562449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:20.570411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d9beaf9d-1200-478f-8375-895dfe195ccc tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.157861 Aug 08 17:36:20.570986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1967/3288] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:20 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:21.591557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:21.592171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:21.598922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:21.599401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:21.599835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:21.600517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:21.600969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:21.601388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:21.727331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:21.735117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-16a9c1ac-9a6e-4923-aa3f-bb65e211a3a5 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147959 Aug 08 17:36:21.735676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1968/3289] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:21 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:22.755349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:22.755989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:22.763066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:22.763551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:22.763989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:22.764680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:22.765130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:22.765552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:22.900094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:22.908135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0c42906-dd3c-443c-88bc-e8f1d665ceec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.156610 Aug 08 17:36:22.909034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1969/3290] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:22 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:23.929343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:23.930033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:23.936883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:23.937363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:23.937807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:23.938496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:23.938975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:23.939397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:24.064513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:24.067875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:24.072536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2188488e-16ef-49df-bcad-7bf359968d7a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147133 Aug 08 17:36:24.073084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1970/3291] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:23 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:25.093729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:25.094433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:25.101045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:25.101518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:25.102016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:25.102693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:25.103142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:25.103562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:25.228827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:25.236743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fcddea41-7bc5-4ec5-a709-23aa221f01d1 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147194 Aug 08 17:36:25.237303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1971/3292] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:25 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:26.257758 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:26.258448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:26.265242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:26.265719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:26.266179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:26.266851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:26.267299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:26.267718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:26.396281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:26.405007 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-808052e1-8ceb-4823-97fe-83dd9f39a66f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151078 Aug 08 17:36:26.405571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1972/3293] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:26 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:27.425872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:27.426539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:27.432850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:27.433329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:27.433764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:27.434469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:27.434918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:27.435341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:27.561697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:27.569548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-360289a8-b824-429c-98c7-8480d6e8a98b tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.147536 Aug 08 17:36:27.570130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1973/3294] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:27 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:28.590193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:28.590845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:28.597251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:28.597731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:28.598442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:28.599124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:28.599570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:28.599989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:28.729086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:28.737341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-99466ab4-0756-4f8f-8c09-a990491c5382 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151067 Aug 08 17:36:28.737918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1974/3295] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:28 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:29.758463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:29.759111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:29.766152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:29.766637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:29.767074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:29.767760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:29.768222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:29.768652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:29.897383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:29.906478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4cb9fe7f-e91c-4fd3-a7bd-7716ed524df8 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.151801 Aug 08 17:36:29.907051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1975/3296] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:29 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:30.927654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:30.928277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:30.934694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:30.935176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:30.935608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:30.936283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:30.936732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:30.937149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:31.070243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:31.076029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e756bba2-619b-449d-ae48-9aafe5a17180 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1738 microversion: 2.1 time: 0.152350 Aug 08 17:36:31.076622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1976/3297] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:30 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:31.646339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c02a76f-d2c8-4b72-a321-083083af81a8"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:31.648766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:31.655214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:31.655679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:31.656120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:31.656816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:31.657263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:31.657965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:35.955779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-646d93d3-5cdc-49ff-b291-0f6c5c5e2ecc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "POST /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.312962 Aug 08 17:36:35.956442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1977/3298] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:36:31 2022] POST /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments => generated 194 bytes in 4315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:35.961512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:35.962283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:35.969232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:35.969727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:35.970212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:35.970881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:35.971367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:35.971796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:36.104360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:36.112496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4622873b-e450-4e6b-b408-fa415e060b8c tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1692 microversion: 2.1 time: 0.155082 Aug 08 17:36:36.113069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1978/3299] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:35 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:36:36.123175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7a134fd1-394a-4125-8f5f-3cdccfd1cb0e tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f74387593a0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:36.172253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7a134fd1-394a-4125-8f5f-3cdccfd1cb0e tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/272bcf42-f2cd-499c-9efd-ba153715330e" status: 200 len: 351 microversion: 2.1 time: 0.052825 Aug 08 17:36:36.172994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1979/3300] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:36:36 2022] GET /compute/v2.1/os-volumes/272bcf42-f2cd-499c-9efd-ba153715330e => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:36:37.134613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:37.135241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4529f181-c2fc-4f1e-b6a4-58352038bc0e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:37.141083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:37.141570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:37.142042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:37.142745 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:37.143196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:37.143619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:37.214409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:37.223026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8ad008ba-ce93-4c15-a1c7-5fa3a2aaf9ec tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e" status: 200 len: 1624 microversion: 2.1 time: 0.092816 Aug 08 17:36:37.223863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1980/3301] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:37 2022] GET /compute/v2.1/servers/4529f181-c2fc-4f1e-b6a4-58352038bc0e => generated 1624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:37.244016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a1767b8d-b53f-42bd-835c-7bdb92c3542d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '.version_select at 0x7f74389958b0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:37.321432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a1767b8d-b53f-42bd-835c-7bdb92c3542d tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500971594" status: 202 len: 0 microversion: 2.1 time: 0.081194 Aug 08 17:36:37.322440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1981/3302] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Aug 8 17:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500971594 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:36:37.677124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4529f181-c2fc-4f1e-b6a4-58352038bc0e", "name": "network-vif-deleted", "tag": "5cf65c7c-a2c4-445d-9d09-23f9159fc49d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:37.688357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:37.691357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:37.692017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:37.707763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] Creating event network-vif-deleted:5cf65c7c-a2c4-445d-9d09-23f9159fc49d for instance 4529f181-c2fc-4f1e-b6a4-58352038bc0e on hv-cinder-85221 Aug 08 17:36:37.715610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-0126c6e0-b553-462b-83db-79f42e63214f req-f77063da-6d7d-4ad2-b4f4-6f10762c64b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042296 Aug 08 17:36:37.716466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1982/3303] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:37.914518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a098b845-1202-4a38-98a4-935f9183f0be tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f74387453a0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:37.977209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a098b845-1202-4a38-98a4-935f9183f0be tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b67cdb51-406b-475f-87ae-6271a9545c9e" status: 200 len: 350 microversion: 2.1 time: 0.066873 Aug 08 17:36:37.977780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1983/3304] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:36:37 2022] GET /compute/v2.1/os-volumes/b67cdb51-406b-475f-87ae-6271a9545c9e => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:36:39.731354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9e3502-9913-4006-a9e2-a7c235f37e0d", "name": "network-vif-deleted", "tag": "f414c0b8-73f2-4493-8c86-8dfa7a282e53"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:39.741149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:39.741621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:39.742135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:39.752205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] Creating event network-vif-deleted:f414c0b8-73f2-4493-8c86-8dfa7a282e53 for instance ce9e3502-9913-4006-a9e2-a7c235f37e0d on hv-cinder-85221 Aug 08 17:36:39.757029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-dc90e388-08b0-4601-9f65-e8e8cef1830b req-1e3fb237-4ffa-4feb-99bc-872645f09592 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 Aug 08 17:36:39.757766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1984/3305] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:39.864863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-591915fc-b3dc-465e-8bc3-930646fbd42d tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f743d1649d0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:39.913821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-591915fc-b3dc-465e-8bc3-930646fbd42d tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/900f50ac-b1bf-46ac-bbcf-d72473c84a91" status: 200 len: 351 microversion: 2.1 time: 0.052924 Aug 08 17:36:39.914481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1985/3306] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Aug 8 17:36:39 2022] GET /compute/v2.1/os-volumes/900f50ac-b1bf-46ac-bbcf-d72473c84a91 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:39.926570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-652242f5-af5d-4b22-b64c-57489c16ed8b tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f74387591f0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.007186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-652242f5-af5d-4b22-b64c-57489c16ed8b tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084092 Aug 08 17:36:40.009984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1986/3307] 10.222.0.57 () {58 vars in 1134 bytes} [Mon Aug 8 17:36:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:40.021622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ef59150-4798-4fa2-83ef-abebcb6ffdd0 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f743d165c10>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.121154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ef59150-4798-4fa2-83ef-abebcb6ffdd0 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092177 Aug 08 17:36:40.121154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1987/3308] 10.222.0.57 () {58 vars in 1149 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:40.128376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb060dce-a4ba-4297-86bc-4e31b3ca7c25 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f743878b430>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.234439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb060dce-a4ba-4297-86bc-4e31b3ca7c25 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110471 Aug 08 17:36:40.236213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1988/3309] 10.222.0.57 () {58 vars in 1134 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:40.246886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-54f6f3ca-ad9f-4566-b999-7147fdafa573 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f7438745310>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.329441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-54f6f3ca-ad9f-4566-b999-7147fdafa573 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085959 Aug 08 17:36:40.330055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1989/3310] 10.222.0.57 () {58 vars in 1167 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:40.342572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1336c7c3-d85f-4081-a8e5-13ae62897170 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f74389958b0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.427126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1336c7c3-d85f-4081-a8e5-13ae62897170 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087984 Aug 08 17:36:40.427780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1990/3311] 10.222.0.57 () {58 vars in 1170 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:40.441267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b706da91-fa5d-41af-b28a-702d48eadd74 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f743884f040>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.522504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b706da91-fa5d-41af-b28a-702d48eadd74 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084850 Aug 08 17:36:40.523071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1991/3312] 10.222.0.57 () {58 vars in 1155 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:40.535129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5f66a306-41df-4d1d-ac10-a3551be10cb2 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f7438770af0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.617830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5f66a306-41df-4d1d-ac10-a3551be10cb2 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086071 Aug 08 17:36:40.618385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1992/3313] 10.222.0.57 () {58 vars in 1188 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:40.631910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-385be77c-ad87-444e-8eae-074c2ee44835 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] Calling method '.version_select at 0x7f743d1659d0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:40.720751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-385be77c-ad87-444e-8eae-074c2ee44835 tempest-VolumesTestJSON-478435363 tempest-VolumesTestJSON-478435363-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092514 Aug 08 17:36:40.721314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1993/3314] 10.222.0.57 () {58 vars in 1155 bytes} [Mon Aug 8 17:36:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:41.201456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:41.202592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:41.208983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:41.209481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:41.209951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:41.210644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:41.211102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:41.211529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:41.238182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:36:41.602339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d5e31bf5-f185-4853-a373-052c2d8e827f tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 204 len: 0 microversion: 2.1 time: 0.405057 Aug 08 17:36:41.603173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1994/3315] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:41 2022] DELETE /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:36:41.611254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:41.611953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:41.661726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:41.661726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:41.661726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:41.661726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:41.662235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:41.662235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:41.751107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:41.758863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f16379f7-d616-4cf0-90bb-aaade71fbea7 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1509 microversion: 2.1 time: 0.151510 Aug 08 17:36:41.759531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1995/3316] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:41 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:42.780821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:42.781525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:42.783886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:42.788640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:42.793225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:42.793225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:42.793225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:42.793225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:42.793635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:42.934381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:42.941116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d9983ff5-978d-40b5-bc83-f78cd4527603 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1509 microversion: 2.1 time: 0.164725 Aug 08 17:36:42.941692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1996/3317] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:42 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:42.955936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6a33b1-1daa-484f-9980-ce179a581c15", "name": "network-vif-deleted", "tag": "08fa73c0-81da-4cbe-af4b-96ae37f81ad9"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:42.965216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:42.965690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:42.966196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:42.977513 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] Creating event network-vif-deleted:08fa73c0-81da-4cbe-af4b-96ae37f81ad9 for instance 4f6a33b1-1daa-484f-9980-ce179a581c15 on hv-cinder-85221 Aug 08 17:36:42.982443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-d478bb23-1b0c-47bb-aa53-a19e46f4981d req-2da74ad0-a203-4277-9e58-aacfc5d6bfcf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030079 Aug 08 17:36:42.983013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1997/3318] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:36:43.965568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:43.966291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:43.972565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:43.973049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:43.973746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:43.974458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:43.974911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:43.975365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:43.993131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:44.038224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:44.046027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0b5e46ff-828b-4fe9-a0b1-5f0e460f95fa tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1467 microversion: 2.1 time: 0.085419 Aug 08 17:36:44.046584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1998/3319] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:43 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1467 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:45.067262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:45.067923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:45.074849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:45.075331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:45.075766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:45.076447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:45.076900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:45.077325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:45.138715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:45.146146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-de7b9edb-fb10-4cb8-b887-c1674874dfd6 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1467 microversion: 2.1 time: 0.083382 Aug 08 17:36:45.146706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 1999/3320] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:45 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1467 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:46.166878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:46.167537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:46.173775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:46.174284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:46.174739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:46.175402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:46.175858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:46.176280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:46.206543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:46.207016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:46.207454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:46.207897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'fault' on Instance uuid 4f6a33b1-1daa-484f-9980-ce179a581c15 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:36:46.249394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:46.257333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a661cf65-8acb-474d-a173-6bf4f947f0f2 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1312 microversion: 2.1 time: 0.094300 Aug 08 17:36:46.260670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2000/3321] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:46 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:47.278818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:47.279601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:47.290270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:47.290270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:47.290270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:47.290270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:47.290886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:47.290886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:47.332220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:47.332220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:47.332220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:47.332220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'fault' on Instance uuid 4f6a33b1-1daa-484f-9980-ce179a581c15 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:36:47.378841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:47.387039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fd421649-33ac-4f82-84bb-94813a4d6c87 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 200 len: 1312 microversion: 2.1 time: 0.112512 Aug 08 17:36:47.387620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2001/3322] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:47 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:48.357526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:48.358231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:48.364738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.365212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.365643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.366345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.366796 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.367222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.447445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lazy-loading 'services' on Instance uuid 8dfd5df8-916a-4085-93d4-26fa2756ce2f {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:36:48.634484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dce9ce07-bfb6-4c1c-8917-0a1418db2453 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments/5c02a76f-d2c8-4b72-a321-083083af81a8" status: 202 len: 0 microversion: 2.1 time: 0.280582 Aug 08 17:36:48.635354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2002/3323] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:36:48 2022] DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments/5c02a76f-d2c8-4b72-a321-083083af81a8 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:36:48.642094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:48.642791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 4f6a33b1-1daa-484f-9980-ce179a581c15] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:48.649104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.649839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.650267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.650958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.651411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.651832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.665125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 HTTP/1.1 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:48.666814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. Aug 08 17:36:48.668734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '4f6a33b1-1daa-484f-9980-ce179a581c15'} Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:48.669678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. Aug 08 17:36:48.671161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:48.673230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 404 to user: Instance 4f6a33b1-1daa-484f-9980-ce179a581c15 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:48.673230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b3a2a9b3-15af-433b-91dc-f511938e4e52 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15" status: 404 len: 111 microversion: 2.1 time: 0.031424 Aug 08 17:36:48.673230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2003/3324] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:48 2022] GET /compute/v2.1/servers/4f6a33b1-1daa-484f-9980-ce179a581c15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:48.673230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:48.675885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:48.681645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.682170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.682606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.683296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.683748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.684170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.714365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d1f3a52-6d02-4673-a984-17dce94e4476 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Aug 08 17:36:48.714928 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2004/3325] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:36:48 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:36:48.719722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:48.720224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:48.726381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.731400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.731400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.731400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:48.731400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:48.732037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:48.755835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:36:49.019735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-455058f0-1e2a-4766-b095-fd083a39ffd3 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 204 len: 0 microversion: 2.1 time: 0.303539 Aug 08 17:36:49.020428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2005/3326] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:48 2022] DELETE /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:36:49.030246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:49.030940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:49.037327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:49.037828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:49.038264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:49.039026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:49.039471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:49.039888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:49.172229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:49.180362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c9b3e35-467f-4b3d-8fea-4cadb7511da9 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.154429 Aug 08 17:36:49.180949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2006/3327] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:49 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:36:49.726522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:49.728824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:49.735294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:49.735778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:49.736215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:49.736904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:49.737388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:49.737828 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:49.769064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59136ebc-9655-46b5-8163-61a8ccf87f11 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 08 17:36:49.769623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2007/3328] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:36:49 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:50.205843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:50.206598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:50.212443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.217588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.217588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.217588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.217588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.218058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.363179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:50.371354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccff7b20-3d50-45ab-8bc3-8f92a73c9665 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1522 microversion: 2.1 time: 0.169044 Aug 08 17:36:50.372253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2008/3329] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:50 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:50.407132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3506c2e4-aa88-4ed1-aa43-8d51b419907d", "name": "network-vif-deleted", "tag": "a5236cb8-d875-46e6-abc5-0f4357f6e84d"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:50.417161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.423926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.423926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.431164 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] Creating event network-vif-deleted:a5236cb8-d875-46e6-abc5-0f4357f6e84d for instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d on hv-cinder-85221 Aug 08 17:36:50.436215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-fa51c231-7426-4aea-ae87-04aed3126763 req-1b5c9c76-26f7-406a-9496-31d79f07c291 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032806 Aug 08 17:36:50.436739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2009/3330] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:36:50.782040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:50.785018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:50.791628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.792232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.792687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.793378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.793937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.794364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.828791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ba17fa7b-95dd-4b34-ad24-110934a8bbe2 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051423 Aug 08 17:36:50.829360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2010/3331] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:36:50 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 17:36:50.898150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:50.898649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:50.904520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.904996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.905467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.906170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:50.906617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:50.911516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:50.931507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:36:51.071713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:51.242313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ac57216f-3b0f-4401-825e-a019049f1a9a tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 204 len: 0 microversion: 2.1 time: 0.347769 Aug 08 17:36:51.242905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2011/3332] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:50 2022] DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:36:51.251184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:51.251873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:51.258414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:51.258900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:51.259401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:51.260088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:51.260607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:51.261037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:51.391627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:51.399769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb96c12b-9e2e-4d3e-9358-b80e2bdb22f5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1679 microversion: 2.1 time: 0.152623 Aug 08 17:36:51.400345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2012/3333] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:51 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:51.404685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:51.405290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:51.411004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:51.411489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:51.411923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:51.412606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:51.413059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:51.413485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:51.443754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:51.444441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:51.444817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:51.445273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'fault' on Instance uuid 3506c2e4-aa88-4ed1-aa43-8d51b419907d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:36:51.490160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:51.497568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e963b849-88dd-401b-8fc1-b206991b0694 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1312 microversion: 2.1 time: 0.096299 Aug 08 17:36:51.498179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2013/3334] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:51 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:36:52.421590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:52.422316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:52.429411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:52.429930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:52.430365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:52.431047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:52.431500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:52.431926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:52.561069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:52.568652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7b665fe-bd8f-4ae3-a7c0-e1b53492f114 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1679 microversion: 2.1 time: 0.150973 Aug 08 17:36:52.569220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2014/3335] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:52 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:52.574950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:52.577235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:52.581944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:52.582236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:52.582683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:52.583367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:52.583824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:52.584245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:52.615693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:52.616171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:52.616603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:52.617049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lazy-loading 'fault' on Instance uuid 3506c2e4-aa88-4ed1-aa43-8d51b419907d {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:36:52.658105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e9bd6db85b4decbdac1908912d158c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3cc7413c0c4603a7898fd5b0d6a765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:52.665467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9be1215f-5034-4042-b53f-69f2789a2675 tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 200 len: 1312 microversion: 2.1 time: 0.094054 Aug 08 17:36:52.666057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2015/3336] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:52 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:36:53.590845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:53.591581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:53.599347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:53.599834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:53.600331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:53.601026 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:53.601481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:53.601934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:53.686974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:53.695894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eec73f76-5d8f-431a-a487-68f42bc76df1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1612 microversion: 2.1 time: 0.109120 Aug 08 17:36:53.697377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2016/3337] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:53 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:53.726634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:53.727561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] [instance: 3506c2e4-aa88-4ed1-aa43-8d51b419907d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:53.735833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:53.736329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:53.736760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:53.738025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:53.738475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:53.738895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:53.756018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] HTTP exception thrown: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Request method failure captured: Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d HTTP/1.1 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UEkFyQYhshZPGG0m-6fAG31w0NIs2Zf9FidsrmfH_47zxDEM3-Y4AhtwfF1inuah5Ulc6cG25r0IkA3cd3szQJLY0p4kY9gsXcZ7sHfRFxjF7KP_KOB_1NFysIybYemcV-Y_HjOW2Lnff_F4Khihh0UC_O_N8fuSlVhZYEnCXvSyuU Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:53.757762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1a3cc7413c0c4603a7898fd5b0d6a765", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1a3cc7413c0c4603a7898fd5b0d6a765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 1a3cc7413c0c4603a7898fd5b0d6a765 Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-143248100 Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: d6e9bd6db85b4decbdac1908912d158c Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-ServerRescueNegativeTestJSON-143248100-project Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. Aug 08 17:36:53.759421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '3506c2e4-aa88-4ed1-aa43-8d51b419907d'} Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:53.760350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. Aug 08 17:36:53.761894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:53.763333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] Returning 404 to user: Instance 3506c2e4-aa88-4ed1-aa43-8d51b419907d could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:53.763333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7e39aed-68d0-4592-8e55-f7340cf2891a tempest-ServerRescueNegativeTestJSON-143248100 tempest-ServerRescueNegativeTestJSON-143248100-project] 10.222.0.57 "GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d" status: 404 len: 111 microversion: 2.1 time: 0.060548 Aug 08 17:36:53.763333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2017/3338] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:53 2022] GET /compute/v2.1/servers/3506c2e4-aa88-4ed1-aa43-8d51b419907d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:54.351078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfd5df8-916a-4085-93d4-26fa2756ce2f", "name": "network-vif-deleted", "tag": "a3cb8f55-9a30-4b1d-b100-97cd3ada14e8"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:36:54.385744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:54.386581 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:54.387054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:54.407433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] Creating event network-vif-deleted:a3cb8f55-9a30-4b1d-b100-97cd3ada14e8 for instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f on hv-cinder-85221 Aug 08 17:36:54.416170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-e3e13280-5da1-41b5-bdac-df8d1bd9697c req-8f8e2953-f03d-483e-95e7-4647bfd95ad7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075949 Aug 08 17:36:54.425833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2018/3339] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:36:54.718917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:54.719640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:54.726350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:54.727096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:54.727852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:54.729038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:54.729983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:54.730416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:54.812667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ed5f2559a449fbe0b30bfeabd90df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cab17504d403d89b8cfff76632c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:36:54.821191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fc31b745-79fd-40b5-bd12-6ece312eb7cc tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 200 len: 1325 microversion: 2.1 time: 0.108288 Aug 08 17:36:54.821757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2019/3340] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:54 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 1325 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:36:55.842605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:55.843632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:55.851113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:55.851589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:55.852292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:55.853056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:55.853898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:55.854539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:55.870003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f HTTP/1.1 Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:55.872085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:55.873699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8dfd5df8-916a-4085-93d4-26fa2756ce2f'} Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:55.874596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:55.875958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:55.877292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:55.877292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7dac0994-e627-43a7-836d-fee9448507c1 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 404 len: 111 microversion: 2.1 time: 0.035143 Aug 08 17:36:55.879615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2020/3341] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:55 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:55.885598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5b1c23c4-2882-4cd6-aeba-08f94c260a89 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '.version_select at 0x7f743d153940>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:55.986589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5b1c23c4-2882-4cd6-aeba-08f94c260a89 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242355779" status: 202 len: 0 microversion: 2.1 time: 0.105568 Aug 08 17:36:55.987234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2021/3342] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Aug 8 17:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242355779 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:36:58.310308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.314609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.345964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.347073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.347516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.352046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.352523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.352975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.371698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f HTTP/1.1 Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.373738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.375382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8dfd5df8-916a-4085-93d4-26fa2756ce2f'} Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.376222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.377652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.381112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.381112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e9bd73ef-2a7f-4e67-848d-c2ec2b7ecced tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 404 len: 111 microversion: 2.1 time: 0.071843 Aug 08 17:36:58.381112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2022/3343] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:58 2022] DELETE /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:58.385347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.386713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8dfd5df8-916a-4085-93d4-26fa2756ce2f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.392894 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.393938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.394544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.395273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.395723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.398591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.410701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f HTTP/1.1 Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.412488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.414059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8dfd5df8-916a-4085-93d4-26fa2756ce2f'} Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.415038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. Aug 08 17:36:58.416400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.418130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8dfd5df8-916a-4085-93d4-26fa2756ce2f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.418130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4ab132b-0b10-4249-97ec-c671653eae61 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f" status: 404 len: 111 microversion: 2.1 time: 0.032192 Aug 08 17:36:58.418130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2023/3344] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:58 2022] GET /compute/v2.1/servers/8dfd5df8-916a-4085-93d4-26fa2756ce2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:58.424425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.424425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.429019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.429496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.429972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.430653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.431100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.431565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.445006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f HTTP/1.1 Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.446802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.451836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8c346445-9089-4df6-a9ae-ad2483c9814f'} Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.452844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.454575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.456845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.456845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6b745292-f945-44c4-82ff-376d3ce2e632 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 404 len: 111 microversion: 2.1 time: 0.029336 Aug 08 17:36:58.456845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2024/3345] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:58 2022] DELETE /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:36:58.457294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.457923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 8c346445-9089-4df6-a9ae-ad2483c9814f] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.463628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.464102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.464531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.465202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.465648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.466103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.480294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f HTTP/1.1 Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.481955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.483748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '8c346445-9089-4df6-a9ae-ad2483c9814f'} Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.484730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. Aug 08 17:36:58.486372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.487955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 8c346445-9089-4df6-a9ae-ad2483c9814f could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.487955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ef977f36-4329-4294-80a9-1369e58d7b14 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f" status: 404 len: 111 microversion: 2.1 time: 0.030122 Aug 08 17:36:58.487955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2025/3346] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:58 2022] GET /compute/v2.1/servers/8c346445-9089-4df6-a9ae-ad2483c9814f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:58.491366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.491848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.497857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.498334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.498762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.499431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.499875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.500331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.513338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab HTTP/1.1 Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.514916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.516724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '637a5c03-c639-4da1-8b40-5f1ac17b21ab'} Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.517759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.520168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.521878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.521878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6b624b51-0ad0-4c44-9d11-c2f1c110fefd tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 404 len: 111 microversion: 2.1 time: 0.028335 Aug 08 17:36:58.521878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2026/3347] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:58 2022] DELETE /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:36:58.524608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:58.525201 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 637a5c03-c639-4da1-8b40-5f1ac17b21ab] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:58.531080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.531612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.538306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.538306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:58.538306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:58.538306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:58.547365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab HTTP/1.1 Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:58.557728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.562571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '637a5c03-c639-4da1-8b40-5f1ac17b21ab'} Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:58.563705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. Aug 08 17:36:58.565706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:58.569133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 637a5c03-c639-4da1-8b40-5f1ac17b21ab could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:58.569133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1cc694d9-7b11-4d0e-a5b1-853114af53a7 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab" status: 404 len: 111 microversion: 2.1 time: 0.038043 Aug 08 17:36:58.569133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2027/3348] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:58 2022] GET /compute/v2.1/servers/637a5c03-c639-4da1-8b40-5f1ac17b21ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:36:59.861548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:59.863450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:59.870229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:59.870940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:59.871544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:59.876349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:59.877041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:59.878793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:59.897234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e HTTP/1.1 Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:59.899270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.901046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '97c06d12-050a-4dbb-9d04-30953de7661e'} Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:59.902086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.903826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.906961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:59.908333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c157dd5c-039c-49c5-b34d-e9ac721fc9d5 tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 404 len: 111 microversion: 2.1 time: 0.050571 Aug 08 17:36:59.909092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2028/3349] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:36:59 2022] DELETE /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:36:59.926688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:36:59.926688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] [instance: 97c06d12-050a-4dbb-9d04-30953de7661e] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:36:59.929004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:59.929484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:59.929946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:59.930637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:36:59.931126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:36:59.931776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:36:59.949400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] HTTP exception thrown: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Request method failure captured: Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e HTTP/1.1 Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UGHFHIShfMdOmJJw2WObPyk5evjZ66c56PRG-6nXF36WokHfoOjWh4HahU8o7DtuI4jiB0S5b5ZSXoyj7sPkMrWLLGsjcegUXMs0W2vvR-GpVakOt-9i5kgT6kaILOwgUP45TrQmeQv_F9nUGA4lyznu2X4RZHE3kie2hV8_prJ-pU Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:36:59.955030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_880cab17504d403d89b8cfff76632c6b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/880cab17504d403d89b8cfff76632c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 880cab17504d403d89b8cfff76632c6b Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1563901719 Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 5a7ed5f2559a449fbe0b30bfeabd90df Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeNegativeTest-1563901719-project Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.957003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '97c06d12-050a-4dbb-9d04-30953de7661e'} Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:36:59.958050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. Aug 08 17:36:59.959709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:36:59.962038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] Returning 404 to user: Instance 97c06d12-050a-4dbb-9d04-30953de7661e could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:36:59.962038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa6fab20-6798-4a44-b41e-509f067d464b tempest-AttachVolumeNegativeTest-1563901719 tempest-AttachVolumeNegativeTest-1563901719-project] 10.222.0.57 "GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e" status: 404 len: 111 microversion: 2.1 time: 0.039282 Aug 08 17:36:59.962038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2029/3350] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:36:59 2022] GET /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:37:01.613625 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:37:01.614438 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:37:05.472366 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:37:05.473022 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:37:09.923975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:09.950306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=62 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:10.279961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ed3c3e2-866c-45e0-804e-e811b3aabec4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: .version_select at 0x7f743884f3a0>, body: {"keypair": {"name": "tempest-keypair-2070252123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXqKxCii9G/clzrr1ARJWBObeLXlHjUdEyADw/GZobmmb0IncC8RijUl0JQlcZkpwFVF+4Hbw16hl+L0Sege5k8eRz2KlU2mhftrfasSvc8NHoQgFaAKLcpQWLvDfndlA=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:10.303423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-4ed3c3e2-866c-45e0-804e-e811b3aabec4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for project e449345a18254a1ab181cbbcfafa33c8. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:10.307827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-4ed3c3e2-866c-45e0-804e-e811b3aabec4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for user 054f2a730eaa4a32b11f4a731c687094 and project e449345a18254a1ab181cbbcfafa33c8. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:10.424812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ed3c3e2-866c-45e0-804e-e811b3aabec4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.518411 Aug 08 17:37:10.427066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2030/3351] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:37:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:37:13.972661 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1516136120", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64c0f3e2-9863-4a7b-846c-017265c5dd63"}], "security_groups": [{"name": "tempest-securitygroup--593513041"}], "key_name": "tempest-keypair-2070252123", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:14.117748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] validate_networks() for [('64c0f3e2-9863-4a7b-846c-017265c5dd63', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:37:15.249385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:37:15.249385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:37:15.249385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:37:15.249385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:37:15.249385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:37:15.264144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:15.264637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:15.265328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:15.266103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:15.266909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:15.267791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:15.297557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for project e449345a18254a1ab181cbbcfafa33c8. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:15.303915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for user 054f2a730eaa4a32b11f4a731c687094 and project e449345a18254a1ab181cbbcfafa33c8. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:15.324307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:37:15.327350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:37:15.501596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fd697fa8-86b2-4b70-aa39-3f78ca6a2a62 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.535215 Aug 08 17:37:15.502282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2031/3352] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:37:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:37:15.513402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5fac0f62-dd5d-4a01-a2a8-e8663d38c647 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:15.514462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5fac0f62-dd5d-4a01-a2a8-e8663d38c647 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:15.658428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5fac0f62-dd5d-4a01-a2a8-e8663d38c647 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:15.671025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5fac0f62-dd5d-4a01-a2a8-e8663d38c647 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1238 microversion: 2.1 time: 0.160892 Aug 08 17:37:15.671713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2032/3353] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:15 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:16.702442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d518e326-3648-4901-b54c-cc07bac6b2b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:16.703545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d518e326-3648-4901-b54c-cc07bac6b2b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:16.839534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d518e326-3648-4901-b54c-cc07bac6b2b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:16.858034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d518e326-3648-4901-b54c-cc07bac6b2b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1238 microversion: 2.1 time: 0.169080 Aug 08 17:37:16.861577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2033/3354] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:16 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1238 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:17.881870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:17.882650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:17.890606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:17.891374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:17.891987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:17.893592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:17.895733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:17.896965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:18.021376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:18.042415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-86352e44-ed24-4882-a7ef-bf6ef20560a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1234 microversion: 2.1 time: 0.165376 Aug 08 17:37:18.043008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2034/3355] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:17 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1234 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:19.064538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:19.065048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:19.081374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:19.081904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:19.082353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:19.083062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:19.099920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:19.100836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:19.211559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:19.226210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa48ca79-8a36-48da-8fd5-873970e4c26e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1296 microversion: 2.1 time: 0.166178 Aug 08 17:37:19.237988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2035/3356] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:19 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:20.262626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:20.262626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:20.276063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:20.276567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:20.277012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:20.277731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:20.278221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:20.278652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:20.443149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:20.451178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05593279-d502-4787-ae9e-7b43dda8e240 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.201691 Aug 08 17:37:20.452454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2036/3357] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:20 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:21.258312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ac19ec1-1e77-4a81-a232-d18ccfe33c77 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Action: 'create', calling method: .version_select at 0x7f7438730940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1174986336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhjNXy/uP4IZNIrtDjKMSSkwHjO6gWlW18i4n3eMJncPIJrOInDgqOlm30nADAw+YsGijnJNTgEeqC+wiYLkkchSinzQi7ZOF+IkBkt8TW4fhDtIPlpOVVag4MZe9HJ6A=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:21.277675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-6ac19ec1-1e77-4a81-a232-d18ccfe33c77 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for project 0f857768418e43d8bdbab85be767b896. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:21.284277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-6ac19ec1-1e77-4a81-a232-d18ccfe33c77 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for user 57662358169d4830b2ebb7d594efb701 and project 0f857768418e43d8bdbab85be767b896. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:21.395496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ac19ec1-1e77-4a81-a232-d18ccfe33c77 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.482729 Aug 08 17:37:21.405548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2037/3358] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:37:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:37:21.411881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ff2375-7d4e-4267-b9c6-f59f74409e1c", "tag": "ad0fc363-c342-459d-a322-5b0b813a673c"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:21.423920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:21.425401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:21.426112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:21.439244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] Creating event network-changed:ad0fc363-c342-459d-a322-5b0b813a673c for instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c on hv-cinder-85221 Aug 08 17:37:21.445417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-6458ce5e-ffed-40de-b3cd-8623ca0116a2 req-0e054dda-636d-41eb-842a-fc9d27faa23b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038294 Aug 08 17:37:21.446893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2038/3359] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:37:21.479988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:21.482332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:21.526780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:21.538160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:21.538160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:21.538160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:21.538160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:21.543076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:21.770715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:21.780718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1885c013-0b58-4ec6-afcb-2f84ec5586a4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.310935 Aug 08 17:37:21.781317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2039/3360] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:21 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:22.807451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:22.808733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:22.817272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:22.818117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:22.818781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:22.820084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:22.820730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:22.821178 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:23.110012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:23.119979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cfa12cc1-6c1a-4d0f-86d1-42c6b769d62f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.316504 Aug 08 17:37:23.121813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2040/3361] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:22 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:24.146276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:24.147004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:24.154765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:24.155370 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:24.155858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:24.157226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:24.157903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:24.158406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:24.357466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:24.367960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63522fe5-fbba-48b9-922c-f53417418081 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.229534 Aug 08 17:37:24.381934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2041/3362] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:24 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:25.394342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:25.397737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:25.401294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:25.407732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:25.409718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:25.410541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:25.411512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:25.412216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:25.413136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:25.681361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:25.688891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-406e9ba8-93bf-4c46-b2ff-d7c9fed35d7c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.301103 Aug 08 17:37:25.689668 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2042/3363] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:25 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:26.072419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ff2375-7d4e-4267-b9c6-f59f74409e1c", "name": "network-vif-plugged", "status": "completed", "tag": "ad0fc363-c342-459d-a322-5b0b813a673c"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:26.084488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:26.085062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:26.086113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:26.099126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] Creating event network-vif-plugged:ad0fc363-c342-459d-a322-5b0b813a673c for instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c on hv-cinder-85221 Aug 08 17:37:26.113000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-205cdcc0-4f9f-4dbe-bf72-338fb4227a36 req-8f74e2d7-7991-4de2-ad43-c1e6534e7a23 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044995 Aug 08 17:37:26.114340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2043/3364] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:37:26.717877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:26.718851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:26.725853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:26.726357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:26.726800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:26.727506 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:26.727962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:26.728422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:27.340871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:27.358875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a0fd88a6-2575-493e-b0db-a35c8fcfb0ae tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.646490 Aug 08 17:37:27.360046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2044/3365] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:26 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:28.380481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:28.381134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:28.390027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:28.391096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:28.391887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:28.394019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:28.394721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:28.395856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:28.545942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:28.553709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2a2fc90-89bc-4da2-9669-a01ee03eb19a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.177590 Aug 08 17:37:28.554630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2045/3366] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:28 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:29.574803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:29.575652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:29.582129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:29.582698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:29.583363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:29.584380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:29.585068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:29.586260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:29.777905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:29.783170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ebc3b4f-91d8-4e54-8684-d6b3d8cf4e4f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.212114 Aug 08 17:37:29.797757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2046/3367] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:29 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:30.805371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:30.806779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:30.813595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:30.814106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:30.814545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:30.815924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:30.816522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:30.817096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:31.009248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:31.017593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b232b04c-1320-4b2b-971f-8ef4bb83a855 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.216148 Aug 08 17:37:31.030658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2047/3368] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:30 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:32.051377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:32.052659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:32.058808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=18 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:32.060901 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:32.061628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:32.062268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:32.063163 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:32.063784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:32.064364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:32.275362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:32.283598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3b173180-31d2-4368-a572-6daf4493243e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1363 microversion: 2.1 time: 0.236959 Aug 08 17:37:32.284522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2048/3369] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:32 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:33.306193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:33.306892 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:33.313660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:33.314186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:33.314619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:33.315841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:33.316293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:33.316719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:33.725598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:33.749906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cd5204ff-ce1b-47ee-9c88-003a9826327a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1549 microversion: 2.1 time: 0.446736 Aug 08 17:37:33.751421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2049/3370] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:33 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1549 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:33.787841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:33.791139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:33.798497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:33.799775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:33.800582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:33.801481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:33.802364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:33.802795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:33.921070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1007da0f-347e-4547-9ecd-f6736496fbbf tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137156 Aug 08 17:37:33.922008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2050/3371] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:37:33 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:37:35.681835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ff2375-7d4e-4267-b9c6-f59f74409e1c", "tag": "ad0fc363-c342-459d-a322-5b0b813a673c"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:35.702235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:35.702735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:35.703175 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:35.758110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] Creating event network-changed:ad0fc363-c342-459d-a322-5b0b813a673c for instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c on hv-cinder-85221 Aug 08 17:37:35.763761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-7a42f2b7-ebde-439d-a2ce-24e3c403e072 req-603e65a0-7e63-42b2-874a-cbd9be17dad7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348295 Aug 08 17:37:35.769721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2051/3372] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:37:47.577128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:47.578080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=90 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:37:47.585847 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-663491299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174986336", "security_groups": [{"name": "tempest-secgroup-smoke-1459570141"}], "block_device_mapping_v2": [{"uuid": "a78af51d-b450-4f05-ac7f-0d31d93d47ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "400b4c68-3dad-4d25-a628-ab8745ed4a6f"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:47.710983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] validate_networks() for [('400b4c68-3dad-4d25-a628-ab8745ed4a6f', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:37:48.188670 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:37:48.189103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:37:48.189613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:37:48.190062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:37:48.190504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:37:48.199193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:48.199701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:48.200134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:48.200852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:48.201324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:48.201729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:48.219777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:48.224457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for user 57662358169d4830b2ebb7d594efb701 and project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:48.283357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:37:48.286042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a78af51d-b450-4f05-ac7f-0d31d93d47ac',volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:37:48.894247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7ced09ab-5e8f-4e4d-b0f0-e757591a9b93 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.318233 Aug 08 17:37:48.894974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2052/3373] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:37:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:37:48.905242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c5e8f9f7-3a7b-47b1-8f78-03a51c18971f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:48.906011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c5e8f9f7-3a7b-47b1-8f78-03a51c18971f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:48.964650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c5e8f9f7-3a7b-47b1-8f78-03a51c18971f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:48.975191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c5e8f9f7-3a7b-47b1-8f78-03a51c18971f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1094 microversion: 2.1 time: 0.071778 Aug 08 17:37:48.975191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2053/3374] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:48 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:49.269658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7177376e-0d89-4989-a94e-4488a80f0336 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'create', calling method: .version_select at 0x7f743d1235e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-939733450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+loQ8f1LZjp94Ce9Ro/KnYDm5h2siYTYzEblNTDybnl9LOR8uysObc596sdJ7q4Tu5XbwV2uJwzAUMOcsnW6Z40whCevRUzh8qbwrsVNjzFBzLosBPRdHPteD0f+9qAg=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:49.287170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7177376e-0d89-4989-a94e-4488a80f0336 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Getting quotas for project f8b25b8f45c84feb869633ea4ee98521. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:49.291063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7177376e-0d89-4989-a94e-4488a80f0336 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Getting quotas for user 640d1ecc20f54d81945ba6003787ebc7 and project f8b25b8f45c84feb869633ea4ee98521. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:49.367472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7177376e-0d89-4989-a94e-4488a80f0336 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.101684 Aug 08 17:37:49.368071 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2054/3375] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:37:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:37:49.423266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1567957162", "imageRef": "75ce7a20-d6da-4bd0-8b28-ab316cd40f5b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-939733450", "networks": [{"uuid": "41a0769f-a63c-4937-86c0-808d2d7ad5dd"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:49.480770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] validate_networks() for [('41a0769f-a63c-4937-86c0-808d2d7ad5dd', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:37:49.863507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:37:49.863938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:37:49.864417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:37:49.864830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:37:49.865284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:37:49.874128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:49.878693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:49.878693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:49.878693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:49.878693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:49.879125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:49.893510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Getting quotas for project f8b25b8f45c84feb869633ea4ee98521. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:37:49.897667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Getting quotas for user 640d1ecc20f54d81945ba6003787ebc7 and project f8b25b8f45c84feb869633ea4ee98521. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:37:49.909456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:37:49.912144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75ce7a20-d6da-4bd0-8b28-ab316cd40f5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:37:50.054572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-15cef146-48f6-4df5-b321-ec7fd39c07a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635147 Aug 08 17:37:50.055226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2055/3376] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:37:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:37:50.059663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-18e7be6d-4c6b-4eb3-89e0-c46d7059dbb0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:50.060261 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-18e7be6d-4c6b-4eb3-89e0-c46d7059dbb0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:50.113455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-18e7be6d-4c6b-4eb3-89e0-c46d7059dbb0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:50.120208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-18e7be6d-4c6b-4eb3-89e0-c46d7059dbb0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1094 microversion: 2.1 time: 0.064029 Aug 08 17:37:50.120783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2056/3377] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:50 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:50.125223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-24d24ac1-b018-4bee-91e9-b1fe138daf9d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:50.125826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-24d24ac1-b018-4bee-91e9-b1fe138daf9d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:50.178233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-24d24ac1-b018-4bee-91e9-b1fe138daf9d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:50.186342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-24d24ac1-b018-4bee-91e9-b1fe138daf9d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1258 microversion: 2.1 time: 0.064526 Aug 08 17:37:50.186954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2057/3378] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:50 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:51.141056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:51.141704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:51.147787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:51.148264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:51.148695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:51.149368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:51.149909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:51.150336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:51.211701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:51.219036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a588b7fb-4774-4bf9-9101-8fffb2ffcba6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1192 microversion: 2.1 time: 0.082313 Aug 08 17:37:51.219590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2058/3379] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:51 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:51.224697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c4ba9ef2-7a91-4f0a-9f0c-a2c802d146a8 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:51.225287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c4ba9ef2-7a91-4f0a-9f0c-a2c802d146a8 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:51.280394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c4ba9ef2-7a91-4f0a-9f0c-a2c802d146a8 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:51.286984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c4ba9ef2-7a91-4f0a-9f0c-a2c802d146a8 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1258 microversion: 2.1 time: 0.066471 Aug 08 17:37:51.287573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2059/3380] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:51 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:52.240895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:52.241585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:52.248401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:52.248885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:52.249323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:52.250041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:52.250498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:52.250937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:52.311326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:52.319677 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b06cb127-3752-48c9-a8f7-35152f6bde56 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1210 microversion: 2.1 time: 0.083163 Aug 08 17:37:52.320247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2060/3381] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:52 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:52.324759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:52.325371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:52.331120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:52.334792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:52.334792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:52.334792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:52.334792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:52.335234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:52.394312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:52.402096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e25d8008-e66d-40be-b821-4e33f7f144f7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1310 microversion: 2.1 time: 0.080782 Aug 08 17:37:52.403947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2061/3382] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:52 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:53.342873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:53.343695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:53.351723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:53.352216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:53.352701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:53.354213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:53.354733 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:53.355161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:53.500029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:53.509502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0e5f7622-e2e7-4801-b0c8-2a67db7fb5f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1278 microversion: 2.1 time: 0.170872 Aug 08 17:37:53.510517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2062/3383] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:53 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:53.529586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:53.530195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:53.540357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:53.540357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:53.540357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:53.540357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:53.540933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:53.540933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:53.657859 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:53.668887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-82d760fe-cc2b-457e-a03a-7fa29aaca489 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1316 microversion: 2.1 time: 0.144805 Aug 08 17:37:53.669781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2063/3384] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:53 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:53.802023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bddccb-7316-4a1c-a94a-10307d7e6a33", "tag": "d8421b6c-a857-435e-b350-ee15ba0d8699"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:37:53.817360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:53.817951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:53.818385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:53.830752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] Creating event network-changed:d8421b6c-a857-435e-b350-ee15ba0d8699 for instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 on hv-cinder-85221 Aug 08 17:37:53.837446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-95cdb3ee-3012-4454-b899-39fdc84f51f9 req-423a7a7a-e54d-4f93-a4aa-a71b6dcac67d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040053 Aug 08 17:37:53.838217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2064/3385] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:37:54.539666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:54.541867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:54.556893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:54.557815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:54.558653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:54.559933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:54.560875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:54.561914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:54.728615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:54.737728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0f5012d3-5106-4464-97d9-4aec054973e2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.205879 Aug 08 17:37:54.739353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2065/3386] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:54 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:54.744525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:54.745763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:54.753312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:54.757358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:54.757358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:54.757358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:54.757358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:54.757782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:54.910384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:54.921721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb837834-f1fc-4504-b9aa-7ced73a41209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.181008 Aug 08 17:37:54.922334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2066/3387] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:54 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:55.765738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:55.766652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:55.774283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:55.774853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:55.775378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:55.776140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:55.776672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:55.777173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:55.922883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:55.930704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a27d443-9bdf-4507-9038-86411eb00b51 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.169385 Aug 08 17:37:55.931288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2067/3388] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:55 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:55.943196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:55.943960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:55.951101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:55.951678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:55.952185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:55.952999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:55.953640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:55.954213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:56.090920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:56.098945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2033f533-5645-4458-b8ac-3d48a2aa128e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.159835 Aug 08 17:37:56.099789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2068/3389] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:55 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:56.952572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:56.954027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:56.961305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:56.961809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:56.962260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:56.962964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:56.963440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:56.964113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:57.108056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:57.116642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5ef3bcc5-1dac-462e-bd7a-2eaa4cb38a15 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.168379 Aug 08 17:37:57.130809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2069/3390] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:56 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:57.132231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:57.133036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:57.139632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:57.140195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:57.140692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:57.141452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:57.141931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:57.142413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:57.281692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:57.290391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9754aa8e-9cbf-4dc4-acb0-0de5000e15ce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.162675 Aug 08 17:37:57.290980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2070/3391] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:57 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:58.138476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:58.139174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:58.145481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:58.146000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:58.146436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:58.147110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:58.147562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:58.147984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:58.323926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:58.323926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-623282ca-28bc-4cc7-91c6-2c80cb75a038 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.181388 Aug 08 17:37:58.323926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2071/3392] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:58 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:58.323926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:58.324425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:58.329326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:58.329886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:58.330398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:58.331070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:58.331690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:58.332338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:58.493217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:58.498270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7210f721-2876-4f19-8d35-a387072c9d8f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.179334 Aug 08 17:37:58.499011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2072/3393] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:58 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:37:59.343460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:59.344249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:59.351827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:59.352316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:59.352755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:59.353455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:59.353939 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:59.354363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:59.509504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:59.522059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7d572ff6-d45b-4c34-b93e-10929acf913f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.179294 Aug 08 17:37:59.526723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2073/3394] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:59 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:37:59.531512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:37:59.532120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:37:59.538639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:59.539137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:59.539574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:59.540277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:37:59.540729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:37:59.541156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:37:59.847268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:37:59.856561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b77e6e15-df3d-4cbd-acf1-4eb5921ee3cc tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.328759 Aug 08 17:37:59.857321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2074/3395] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:37:59 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:00.540216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:00.540949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:00.542974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:00.548247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:00.548734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:00.549171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:00.549888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:00.550342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:00.559063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:00.570704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:00.682339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:00.690935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-af853436-db3d-4ffe-8883-7ccf6041c6a0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.153355 Aug 08 17:38:00.690935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2075/3396] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:00 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:00.880648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:00.881571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:00.884768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:00.888505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:00.888999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:00.889466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:00.890159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:00.890613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:00.891032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:01.033325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:01.042019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-75a008ac-d62b-4be3-a759-4937697664fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.165099 Aug 08 17:38:01.045474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2076/3397] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:00 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:01.712601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:01.713669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:01.715624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=24 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:01.721134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:01.721630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:01.722114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:01.722817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:01.723277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:01.723964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:01.860766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:01.868529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63ff9b40-0cff-409a-bbfc-f8b3d265e6f7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.160947 Aug 08 17:38:01.869115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2077/3398] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:01 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:02.063729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:02.064424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:02.071075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:02.071559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:02.071995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:02.072684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:02.073131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:02.073553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:02.207331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:02.215196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-68a24011-09e3-4833-a5eb-d9a7ac9259ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.155662 Aug 08 17:38:02.215805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2078/3399] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:02 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:02.888888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:02.889598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:02.895813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:02.896780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:02.897205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:02.897907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:02.898356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:02.898775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:03.030061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:03.038042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44c6213d-45c4-49f1-9d46-a215c6aafe26 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.153013 Aug 08 17:38:03.038588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2079/3400] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:02 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:03.235817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:03.238398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:03.242514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:03.242997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:03.243429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:03.244109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:03.244569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:03.245045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:03.377649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:03.385807 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05bf8b0f-eed5-4a23-9710-c634131f13a5 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.153844 Aug 08 17:38:03.386772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2080/3401] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:03 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:04.059373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:04.060067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:04.067085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:04.067573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:04.068580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:04.069289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:04.069749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:04.070205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:04.204234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:04.212810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6486f9da-81a3-4577-aa20-57633236cf14 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.157279 Aug 08 17:38:04.213391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2081/3402] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:04 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:04.407743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:04.408279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:04.416705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:04.417284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:04.417729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:04.418469 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:04.418932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:04.419380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:04.563413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:04.573386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f7a1ff8-dc58-43df-88e4-47d5cb9aae59 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.169778 Aug 08 17:38:04.573993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2082/3403] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:04 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:04.614889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:04.626137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:04.626623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:04.627060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:04.638510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] Creating event network-changed:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:38:04.645116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-d4cfc705-77ea-4f51-a0da-0a4719cef3cc req-612dcb52-eac3-46b5-bf18-05e92f495585 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033544 Aug 08 17:38:04.645826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2083/3404] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:05.234648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:05.235450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:05.242158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:05.242642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:05.243075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:05.243759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:05.244210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:05.244633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:05.380876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:05.388555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b748601-1f91-4b2f-9cf1-959551fce2d0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.158161 Aug 08 17:38:05.389461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2084/3405] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:05 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:05.594774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:05.595401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:05.601589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:05.602134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:05.602571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:05.603267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:05.603725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:05.604153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:05.731401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:05.739082 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-774f9a47-d0a9-4915-82d8-2184e2f42ed1 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.148696 Aug 08 17:38:05.739698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2085/3406] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:05 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:06.417090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:06.417731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:06.424102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:06.424618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:06.425060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:06.425747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:06.426223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:06.426651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:06.556505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:06.563842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cdde11f3-ad4b-4be6-bf71-8242fbcbb3f0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.150622 Aug 08 17:38:06.564394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2086/3407] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:06 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:06.759897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:06.760439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:06.766403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:06.766878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:06.767317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:06.768029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:06.768480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:06.768907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:06.899931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:06.907381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d6231476-e7ba-4625-ae33-b1a33093fa1b tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.151405 Aug 08 17:38:06.907972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2087/3408] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:06 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:07.584233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:07.584978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:07.591515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:07.591998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:07.592451 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:07.593153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:07.593601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:07.594095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:07.725669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:07.733177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d94c04c2-d043-430a-9c83-91f07939a06f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.152848 Aug 08 17:38:07.733836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2088/3409] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:07 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:07.928083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:07.928693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:07.934479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:07.934959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:07.935393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:07.936075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:07.936523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:07.936941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:08.067447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:08.074904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-14493aec-0e0a-4206-8358-5a5ecc15fa60 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.151257 Aug 08 17:38:08.075465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2089/3410] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:07 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:08.754392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:08.755064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:08.762553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:08.762653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:08.763041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:08.763720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:08.764169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:08.764586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:08.898251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:08.905761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d0323d5a-773e-40d8-ae41-a4d65bf65e9f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.155144 Aug 08 17:38:08.909209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2090/3411] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:08 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:09.096514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:09.097156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:09.103785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:09.104264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:09.104694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:09.105371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:09.105844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:09.106265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:09.233385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:09.241732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4263e8b7-7bc5-4c37-a88e-6e4073f13699 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.149724 Aug 08 17:38:09.242334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2091/3412] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:09 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:09.925984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:09.926629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:09.933617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:09.934142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:09.934580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:09.938277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:09.938277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:09.938277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:10.069020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:10.072729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:10.077471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bdc24980-2c57-4215-bd6a-623a3ec4442b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.155284 Aug 08 17:38:10.078054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2092/3413] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:09 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:10.165494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "name": "network-vif-plugged", "status": "completed", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:10.174749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:10.175222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:10.175647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:10.187264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] Creating event network-vif-plugged:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:38:10.192366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-8ac98024-0953-4e73-b5d3-fe3df933aad8 req-67a9facf-c284-4066-b5a9-e6b6e163a119 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083593 Aug 08 17:38:10.192941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2093/3414] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:10.263234 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:10.263944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:10.270244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:10.270784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:10.271168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:10.272407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:10.272865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:10.273296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:10.405235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:10.413285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4b4cf581-67e1-465e-b291-faaca2ad68c2 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.154443 Aug 08 17:38:10.413863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2094/3415] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:10 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:11.100188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:11.100832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:11.107409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:11.107898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:11.108363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:11.109052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:11.109551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:11.110011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:11.244857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:11.252238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4de5dd51-f5ee-4c8f-a2e7-891dc1945946 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.156238 Aug 08 17:38:11.252791 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2095/3416] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:11 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:11.434826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:11.435460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:11.441445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:11.441992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:11.442432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:11.443142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:11.443597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:11.444020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:11.571434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:11.578809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-20ee3a81-cf2c-4ebb-87ce-ab9c3039140e tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.147981 Aug 08 17:38:11.579365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2096/3417] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:11 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:12.273640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:12.274263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:12.280778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:12.281265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:12.281705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:12.282444 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:12.282906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:12.283337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:12.418079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:12.425586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6f8168af-7954-4839-b9b7-f1bcd48cca8b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.156570 Aug 08 17:38:12.426167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2097/3418] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:12 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:12.599688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:12.600298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:12.606031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:12.606520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:12.606950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:12.607658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:12.608108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:12.608525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:12.734275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:12.742257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2f37027f-0154-41a4-a4cd-3279f285ac6c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.146076 Aug 08 17:38:12.742821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2098/3419] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:12 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:13.447524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:13.448147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:13.454606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:13.455090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:13.455530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:13.456211 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:13.456664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:13.457088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:13.583603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:13.591168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9011e8ce-a82e-4141-aba3-7889d5428a83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.148029 Aug 08 17:38:13.591731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2099/3420] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:13 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:13.762756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:13.763409 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:13.769282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:13.769767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:13.770232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:13.770919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:13.771376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:13.771800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:13.902569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:13.909833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-302adf11-f58c-41fa-9fb3-103d082506cd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.150876 Aug 08 17:38:13.910478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2100/3421] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:13 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:14.612551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:14.613192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:14.620009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:14.620487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:14.620919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:14.623936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:14.623936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:14.623936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:14.752635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:14.760826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6b596c11-a33d-48fb-9737-4a4445602ca7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.152176 Aug 08 17:38:14.761406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2101/3422] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:14 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:14.931280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:14.931889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:14.937709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:14.938215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:14.938649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:14.939323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:14.939771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:14.940189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:15.069130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:15.076395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-41f2d9d0-2f9e-4443-8275-1fad06b596bb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.149335 Aug 08 17:38:15.077228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2102/3423] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:14 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:15.780896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:15.781539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:15.788167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:15.789144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:15.789574 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:15.790276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:15.790726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:15.791146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:15.917740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:15.925209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-60cb39b3-66e0-4f97-ba27-05ed1564afeb tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.148126 Aug 08 17:38:15.925760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2103/3424] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:15 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:16.096803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:16.097439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:16.104097 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:16.104638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:16.105087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:16.105767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:16.106248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:16.106667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:16.236640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:16.244138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c65acf0-67b4-4a50-8911-f96adf03d799 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1358 microversion: 2.1 time: 0.151287 Aug 08 17:38:16.244719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2104/3425] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:16 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:16.947604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:16.948316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:16.954882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:16.955380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:16.955831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:16.956630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:16.957036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:16.957468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.101933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:17.109855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6fb41b2d-c273-4065-b3f9-27e4359bac3e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.166872 Aug 08 17:38:17.110424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2105/3426] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:16 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:17.122701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bddccb-7316-4a1c-a94a-10307d7e6a33", "name": "network-vif-plugged", "status": "completed", "tag": "d8421b6c-a857-435e-b350-ee15ba0d8699"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:17.132935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.133330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.133757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.144827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] Creating event network-vif-plugged:d8421b6c-a857-435e-b350-ee15ba0d8699 for instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 on hv-cinder-85221 Aug 08 17:38:17.149468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-994c7969-114b-4417-9a69-1b0e361bad5e req-846da7d4-7415-4450-9f32-9300a0b11040 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030325 Aug 08 17:38:17.150087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2106/3427] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:17.265410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:17.266143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:17.272232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.272753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.273193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.273906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.274361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.274786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.403212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:17.410941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-30c9eebc-2d48-413a-b76e-efb0951a62fa tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1548 microversion: 2.1 time: 0.150190 Aug 08 17:38:17.411568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2107/3428] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:17 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:17.431328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:17.431938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:17.437734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.438252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.439088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.439418 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.439900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.440333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.574025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:17.583136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8aaf42df-c3de-4f94-b568-bb9b1c6addd7 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1548 microversion: 2.1 time: 0.155576 Aug 08 17:38:17.584289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2108/3429] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:17 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:17.608434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:17.613041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:17.613820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Searching by: {'deleted': False, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521'} {{(pid=130501) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 17:38:17.621276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.621751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.622392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.623044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.623494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.623914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.713679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.multi_cell_list [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130501) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 17:38:17.807974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c66c6e92-486b-482d-b417-983dca3249dd tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203241 Aug 08 17:38:17.808547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2109/3430] 10.222.0.57 () {58 vars in 1125 bytes} [Mon Aug 8 17:38:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:17.819177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:17.819802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:17.825413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.825946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.826382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.827049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:17.827496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:17.827909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:17.845617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:17.954279 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:17.962146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90839fa6-e98c-497a-89ff-500fc5fdf575 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1548 microversion: 2.1 time: 0.146407 Aug 08 17:38:17.962730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2110/3431] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:17 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:18.130972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:18.131576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:18.138192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:18.138673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:18.139123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:18.139829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:18.140220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:18.140636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:18.283905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:18.291589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fe3d15f4-e633-4a58-a37b-7fce7685e8f6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1266 microversion: 2.1 time: 0.164324 Aug 08 17:38:18.292110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2111/3432] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:18 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:19.312190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:19.316530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:19.319404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.319913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.320348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:19.321025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.321479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.321924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:19.452064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:19.459446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b61ca3b-9e3c-47c1-bf21-67c3f9619732 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1452 microversion: 2.1 time: 0.151144 Aug 08 17:38:19.460006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2112/3433] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:19 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:19.480305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:19.480903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:19.486962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.487448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.487876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:19.488554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.489000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.493990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:19.640403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:19.648519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-02276405-ca41-4cd4-ba40-11d7d1c70db2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1452 microversion: 2.1 time: 0.171874 Aug 08 17:38:19.654683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2113/3434] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:19 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:19.882685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:19.885222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:19.891373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.891850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.892283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:19.892971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:19.893421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:19.893865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:20.800701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cdab2f6a-d68d-4260-9b4b-f0dd6dc0cdc3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.922441 Aug 08 17:38:20.801557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2114/3435] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:38:19 2022] POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:20.806887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:20.807583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:20.814157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:20.814882 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:20.815081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:20.815763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:20.816207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:20.816617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:20.842090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f7123748-4974-4f7e-8a9f-7497c124e9d3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039166 Aug 08 17:38:20.842972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2115/3436] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:38:20 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:21.780266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bddccb-7316-4a1c-a94a-10307d7e6a33", "tag": "d8421b6c-a857-435e-b350-ee15ba0d8699"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:21.790546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:21.791107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:21.791674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:21.803054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] Creating event network-changed:d8421b6c-a857-435e-b350-ee15ba0d8699 for instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 on hv-cinder-85221 Aug 08 17:38:21.808091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-89f838fd-830c-494e-98e6-3dcf6eb09f9e req-6587147b-abdc-4b1f-b7f2-a4e61f50462e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033192 Aug 08 17:38:21.808973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2116/3437] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:24.336012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10da34f6-9560-466a-afc7-ff4dae0c80ad"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:24.338622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:24.354649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:24.354649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:24.354649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:24.354649 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:24.354935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:24.354935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:25.114509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4539b159-2aee-4ced-bb20-64b148eb1a12 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783862 Aug 08 17:38:25.115520 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2117/3438] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:38:24 2022] POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:29.497210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:29.497922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:29.500695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:29.505908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:29.506387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:29.506823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:29.507508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:29.508002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:29.508422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:29.645885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:29.655379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-10ceea7c-1797-4f4f-bc9e-812464a5f8da tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1594 microversion: 2.1 time: 0.162845 Aug 08 17:38:29.657035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2118/3439] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:29 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:32.715502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:32.727141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=85 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:32.733397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:32.733978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:32.734642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:32.748653 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] Creating event network-changed:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:38:32.753734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-0fa3e5c5-000f-4998-9c08-ccc84f04e08a req-3cd26a78-b854-4a09-b701-b27d649a39d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041832 Aug 08 17:38:32.754382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2119/3440] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:35.201511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-221135120"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:35.202141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:35.213096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:35.213096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:35.213096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:35.213096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:35.213436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:35.213436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:35.341357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.network.security_group_api [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Adding security group 42b049c6-76fd-4967-9192-f1369d0b2a93 to port bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 Aug 08 17:38:35.782992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e7b016a-0e90-4e5d-81d2-4b35003896de tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action" status: 202 len: 0 microversion: 2.1 time: 0.586298 Aug 08 17:38:35.783925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2120/3441] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:38:35 2022] POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:38:35.792391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:35.793614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:35.806119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:35.806119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:35.806119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:35.806119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:35.806720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:35.806720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:35.966657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:35.975869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-784cb694-d6f8-4349-b997-4c99f6337f16 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1758 microversion: 2.1 time: 0.187953 Aug 08 17:38:35.989632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2121/3442] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:35 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:36.152705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:36.163247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:36.163721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:36.164329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:36.176338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] Creating event network-changed:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:38:36.182073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-dec24c3a-a847-4178-b56c-9659de4d4582 req-120352e3-a5a5-415a-acd6-a83d4fda18a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190877 Aug 08 17:38:36.182761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2122/3443] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:36.931059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:36.937072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:36.937590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:36.938041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:36.998150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Going to try to stop instance {{(pid=130501) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 17:38:37.153839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f90fff9-639c-4700-b8cf-816e79cb665c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.227244 Aug 08 17:38:37.154484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2123/3444] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:38:36 2022] POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:38:37.159543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-816551135", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "networks": [{"uuid": "0cae69c3-56a4-4f4a-acac-1633d99b924e"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:37.212479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] validate_networks() for [('0cae69c3-56a4-4f4a-acac-1633d99b924e', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:38:37.555565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:38:37.556021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:38:37.556498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:38:37.556908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:38:37.557978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:38:37.566694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:37.567172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:37.567603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:37.568321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:37.568772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:37.569192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:37.585346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Getting quotas for project 2a87a1912d31432eaa11f28865ca7d98. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:38:37.589378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Getting quotas for user 3be82c73106c48fa83ab08e96ecbfe81 and project 2a87a1912d31432eaa11f28865ca7d98. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:38:37.600669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:38:37.603063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:38:37.705073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e7dbd1af-b2bb-4741-8cbc-33ec82691bd2 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549374 Aug 08 17:38:37.705669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2124/3445] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:38:37.710184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:37.710792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:37.717672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:37.718166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:37.718600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:37.719285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:37.719740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:37.720167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:37.853564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:37.862459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bd3ff83d-e990-4585-823c-59d602cde34a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.155751 Aug 08 17:38:37.863029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2125/3446] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:37 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:37.867337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7c0ef1e1-cc46-46c3-990b-70c0077bd2f1 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:37.867992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7c0ef1e1-cc46-46c3-990b-70c0077bd2f1 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:37.919109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7c0ef1e1-cc46-46c3-990b-70c0077bd2f1 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:37.925622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7c0ef1e1-cc46-46c3-990b-70c0077bd2f1 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1213 microversion: 2.1 time: 0.061680 Aug 08 17:38:37.926225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2126/3447] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:37 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:38.883536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:38.884136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:38.892015 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:38.892505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:38.892947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:38.893641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:38.894134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:38.894569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:39.025571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:39.029166 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:39.033938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c72134f-7aba-4428-8a37-65bebc2c0b5e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.154268 Aug 08 17:38:39.034504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2127/3448] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:38 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:39.038851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:39.040431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:39.045590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:39.046100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:39.046587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:39.047271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:39.047732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:39.048155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:39.109172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:39.116456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1cd132e8-765b-43cc-9562-61c9a8dc8f1d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1209 microversion: 2.1 time: 0.081033 Aug 08 17:38:39.117009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2128/3449] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:39 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:40.056171 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:40.056836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:40.063747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:40.064267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:40.064694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:40.065456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:40.065953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:40.066358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:40.212143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:40.221123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d68aca41-94a1-45cf-9320-4d0f18655e1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.169131 Aug 08 17:38:40.221806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2129/3450] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:40 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:40.226549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:40.227301 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:40.233112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:40.233701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:40.234274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:40.235037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:40.235584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:40.236076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:40.303342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:40.311442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-19ea303b-1daf-4a9d-8e48-362906089800 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1283 microversion: 2.1 time: 0.088621 Aug 08 17:38:40.312092 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2130/3451] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:40 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:41.243477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:41.244149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:41.250394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:41.250873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:41.251305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:41.252000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:41.252455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:41.252880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:41.381547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:41.390031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-29e6bd8f-dfd0-4dd2-948e-53993ef361ea tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.150323 Aug 08 17:38:41.390583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2131/3452] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:41 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:41.394916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:41.395531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:41.402468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:41.402468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:41.402755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:41.403459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:41.403989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:41.404417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:41.537544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:41.545068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1916fe1a-825a-489f-a274-fe1faec262ee tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.153529 Aug 08 17:38:41.545725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2132/3453] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:41 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:41.686462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855cd643-4ab7-466b-868c-00d388287706", "tag": "dda5e20a-142c-429d-9480-0c0aa6480dbd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:41.697224 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:41.697680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:41.698129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:41.709696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] Creating event network-changed:dda5e20a-142c-429d-9480-0c0aa6480dbd for instance 855cd643-4ab7-466b-868c-00d388287706 on hv-cinder-85221 Aug 08 17:38:41.714875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-c06d7639-9a35-4a69-8049-6940000dd713 req-99ac53ec-f037-4dbf-a477-1f6cc5c2a18f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Aug 08 17:38:41.715825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2133/3454] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:42.412886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:42.413580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:42.420567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:42.421052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:42.421491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:42.422203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:42.422678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:42.425008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:42.558449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:42.568487 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12e88227-3759-45f0-a81c-e4dfb2e1ddd8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.160339 Aug 08 17:38:42.569060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2134/3455] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:42 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:42.573518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:42.574184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:42.580209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:42.580704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:42.581143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:42.581863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:42.582399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:42.582836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:42.718783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:42.727039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-03e74cb1-e1b4-4355-b0b2-fd805218d10e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.156968 Aug 08 17:38:42.728321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2135/3456] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:42 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:43.589365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:43.591185 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:43.597704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:43.598219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:43.598912 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:43.599597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:43.600049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:43.600472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:43.731594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:43.739446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ccae0f41-e918-4154-9975-8ed3a2f8c720 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.153942 Aug 08 17:38:43.740001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2136/3457] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:43 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:43.747726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:43.748328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:43.753906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:43.754384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:43.754815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:43.755505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:43.755935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:43.756351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:43.882044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:43.889334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-08e37809-42ae-4a6c-90de-02029a461291 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.145611 Aug 08 17:38:43.889952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2137/3458] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:43 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:44.760394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:44.761017 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:44.768060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:44.768534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:44.768968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:44.769641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:44.770119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:44.771124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:44.898873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:44.907067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8cc980da-2344-45d3-b1ee-15091ba1297f tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.150468 Aug 08 17:38:44.907658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2138/3459] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:44 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:44.912443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:44.912578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:44.918919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:44.919399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:44.919831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:44.920508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:44.920955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:44.921766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:45.052934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:45.060958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3aacd065-f4ff-4b71-945e-5e8fb7dd6054 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.152383 Aug 08 17:38:45.061511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2139/3460] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:44 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:45.929023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:45.929634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:45.936036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:45.936516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:45.936951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:45.937635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:45.938110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:45.938530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:46.065705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:46.073507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-44072289-d7e6-43cb-b8c7-1392a2151606 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.148377 Aug 08 17:38:46.074124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2140/3461] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:45 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:46.080821 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:46.081515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:46.087076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:46.087643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:46.088060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:46.088739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:46.089187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:46.089610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:46.219766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:46.227550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fa34be79-72f1-4699-9292-241857e7f4af tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.150109 Aug 08 17:38:46.228191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2141/3462] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:46 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:47.095568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:47.096256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:47.103396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:47.103889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:47.104376 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:47.105131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:47.106114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:47.106553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:47.238947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:47.247079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3d9020f1-4212-4f9b-b917-e56da47cfa0a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.155363 Aug 08 17:38:47.247652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2142/3463] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:47 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:47.251948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855cd643-4ab7-466b-868c-00d388287706", "name": "network-vif-plugged", "status": "completed", "tag": "dda5e20a-142c-429d-9480-0c0aa6480dbd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:47.260647 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:47.261111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:47.261532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:47.272535 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] Creating event network-vif-plugged:dda5e20a-142c-429d-9480-0c0aa6480dbd for instance 855cd643-4ab7-466b-868c-00d388287706 on hv-cinder-85221 Aug 08 17:38:47.277350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-8ba16f17-cddf-41a1-8e0f-1f5b1bb7fe77 req-a947b852-52f0-48f7-9ea1-2a5f2ec3ecc3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028517 Aug 08 17:38:47.279067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2143/3464] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:38:47.284000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:47.284692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:47.290613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:47.291093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:47.291539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:47.292217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:47.292675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:47.293101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:47.429127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:47.437055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b0349556-a0a9-4525-94f4-2500e0f80820 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.156879 Aug 08 17:38:47.437700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2144/3465] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:47 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:48.267900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:48.268502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:48.270467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:48.271268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:48.276336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:48.276809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:48.277243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:48.277945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:48.278905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:48.283950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:48.407237 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:48.410748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:48.415425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7cd464ed-f6ec-46ae-812b-cff18e7abeb3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.151373 Aug 08 17:38:48.415981 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2145/3466] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:48 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:48.457428 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:48.458060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:48.463938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:48.464413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:48.464843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:48.465515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:48.466476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:48.466896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:48.595474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:48.603208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-513cfcfc-2401-44f7-83e8-90b95d88978f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1313 microversion: 2.1 time: 0.149615 Aug 08 17:38:48.603766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2146/3467] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:48 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:49.437041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:49.437640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:49.444084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:49.444564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:49.444996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:49.445673 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:49.446151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:49.446570 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:49.577713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:49.586891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cf53dfc3-58ce-47d8-930f-d0675b76e079 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.154261 Aug 08 17:38:49.587665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2147/3468] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:49 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:49.624718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:49.625332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:49.631297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:49.631775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:49.632209 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:49.632887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:49.633338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:49.633801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:49.762251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:49.769593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7af2a1af-c5ea-4dbb-b1d4-d6d9f9f8be85 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1498 microversion: 2.1 time: 0.149302 Aug 08 17:38:49.770181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2148/3469] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:49 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:50.611763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:50.611763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:50.615285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:50.615767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:50.616200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:50.616881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:50.617331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:50.617752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:50.749312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:50.757199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a8eb2b90-4d32-41c4-b7c1-cb8be2832f61 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.152799 Aug 08 17:38:50.757763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2149/3470] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:50 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:50.762055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:50.762550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:50.768787 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:50.769303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:50.769740 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:50.770479 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:50.770936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:50.771360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:50.795499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:38:51.121562 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-40745241-a9de-4bfe-89b6-c0d4b411e98d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "DELETE /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 204 len: 0 microversion: 2.1 time: 0.362573 Aug 08 17:38:51.122794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2150/3471] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:38:50 2022] DELETE /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:38:51.131062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:51.132494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:51.138727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:51.139208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:51.139646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:51.140326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:51.140778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:51.141199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:51.268425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:51.275819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e1cad99-a967-4156-8160-78e1d0d0972f tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1504 microversion: 2.1 time: 0.148705 Aug 08 17:38:51.276373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2151/3472] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:51 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:51.779297 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:51.779937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:51.786241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:51.786715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:51.787142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:51.787816 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:51.788263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:51.788679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:51.913508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:51.921309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f41abe9a-8853-4283-8463-95432a220aba tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.146497 Aug 08 17:38:51.921885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2152/3473] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:51 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:52.296399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:52.297039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:52.303242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:52.303726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:52.304160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:52.304844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:52.305302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:52.305726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:52.437494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:52.445119 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4ecefb21-d966-4565-9a96-25aacc40c142 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1504 microversion: 2.1 time: 0.152550 Aug 08 17:38:52.445769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2153/3474] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:52 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:52.942271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:52.942857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:52.949435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:52.949643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:52.950110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:52.950795 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:52.951247 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:52.951721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:53.078401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:53.086322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a02d1f64-cb27-4125-be2b-182830005b4b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.148016 Aug 08 17:38:53.086887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2154/3475] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:52 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:53.466686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:53.467296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:53.473292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:53.474065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:53.474497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:53.475466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:53.475918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:53.476338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:53.612868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:53.620674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12d25400-6fc9-4757-9c8c-edfddf78a7f8 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1504 microversion: 2.1 time: 0.158463 Aug 08 17:38:53.621453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2155/3476] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:53 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:53.656900 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855cd643-4ab7-466b-868c-00d388287706", "name": "network-vif-deleted", "tag": "dda5e20a-142c-429d-9480-0c0aa6480dbd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:53.666197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:53.666687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:53.667730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:53.678794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] Creating event network-vif-deleted:dda5e20a-142c-429d-9480-0c0aa6480dbd for instance 855cd643-4ab7-466b-868c-00d388287706 on hv-cinder-85221 Aug 08 17:38:53.684033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-b4a69468-4106-40ed-b4e5-af0d0209d75d req-4af48377-08d9-4e6d-a933-d9982f663c1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Aug 08 17:38:53.687478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2156/3477] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:38:54.109213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:54.109926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:54.116041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:54.116522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:54.116982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:54.117658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:54.118141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:54.122811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:54.247484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:54.255865 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-17d9bf20-22f1-42bd-b617-138be6400feb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.151363 Aug 08 17:38:54.256420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2157/3478] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:54 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:54.641832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:54.642449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:54.644438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:54.649114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:54.649597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:54.650249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:54.650910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:54.651432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:54.651811 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:54.685138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:54.685633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:54.686100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:54.686548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lazy-loading 'fault' on Instance uuid 855cd643-4ab7-466b-868c-00d388287706 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:38:54.730664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:54.738699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-84e02e70-f372-4511-b847-11b0837a227a tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 200 len: 1303 microversion: 2.1 time: 0.100793 Aug 08 17:38:54.739267 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2158/3479] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:54 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:55.276825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:55.277450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:55.284253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:55.284731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:55.285158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:55.285850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:55.286302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:55.286725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:55.417373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:55.425223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-56fd3571-aa4d-4a98-821a-6a6a9350713a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.152595 Aug 08 17:38:55.425800 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2159/3480] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:55 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:55.760061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:55.760698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 855cd643-4ab7-466b-868c-00d388287706] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:55.767290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:55.767772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:55.768212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:55.768895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:55.769352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:55.769776 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:55.782949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] HTTP exception thrown: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Request method failure captured: Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 HTTP/1.1 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UoaXUX9QV5XDyVxDZciwDj6x9xAvSJO2gz4Rkt2yxtXjg2FMIUuANfS1p4pKrPmK7xiGdOLwM7cnIG8QrGgOFjPX1Ha4TdxtD_qVROiQ6rpwAs66lnNE7nB80x_4VJj2e1JIuRb-I6Y_S1EDilON91X6qjK1VAgOb6d6heV-kwNnF8 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 2a87a1912d31432eaa11f28865ca7d98 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesActionsTest-392539050 Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:38:55.784591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a87a1912d31432eaa11f28865ca7d98", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesActionsTest-392539050 Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 2a87a1912d31432eaa11f28865ca7d98 Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesActionsTest-392539050 Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesActionsTest-392539050-project Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 3be82c73106c48fa83ab08e96ecbfe81 Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesActionsTest-392539050-project Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. Aug 08 17:38:55.786004 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '855cd643-4ab7-466b-868c-00d388287706'} Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:38:55.786732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. Aug 08 17:38:55.787851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:38:55.788726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Returning 404 to user: Instance 855cd643-4ab7-466b-868c-00d388287706 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:38:55.788726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3127b674-52f1-4779-a3d0-a74d0f052618 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706" status: 404 len: 111 microversion: 2.1 time: 0.029791 Aug 08 17:38:55.788726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2160/3481] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:55 2022] GET /compute/v2.1/servers/855cd643-4ab7-466b-868c-00d388287706 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:38:55.834435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-211415973", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "networks": [{"uuid": "0cae69c3-56a4-4f4a-acac-1633d99b924e"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:55.886739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] validate_networks() for [('0cae69c3-56a4-4f4a-acac-1633d99b924e', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:38:56.228197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:38:56.228615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:38:56.229321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:38:56.229754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:38:56.230193 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:38:56.239572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:56.240102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:56.240534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:56.241242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:56.241687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:56.242130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:56.258100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Getting quotas for project 2a87a1912d31432eaa11f28865ca7d98. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:38:56.262067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Getting quotas for user 3be82c73106c48fa83ab08e96ecbfe81 and project 2a87a1912d31432eaa11f28865ca7d98. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:38:56.272872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:38:56.275100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:38:56.397025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ff8e69f0-2e82-4bf6-978c-e5f8be3e0e04 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566188 Aug 08 17:38:56.397642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2161/3482] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:38:56.408481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-566807de-f2a2-4db7-9d8c-766ed4026c2d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:56.409132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-566807de-f2a2-4db7-9d8c-766ed4026c2d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:56.463518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-566807de-f2a2-4db7-9d8c-766ed4026c2d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:56.471864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-566807de-f2a2-4db7-9d8c-766ed4026c2d tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1213 microversion: 2.1 time: 0.067553 Aug 08 17:38:56.472420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2162/3483] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:56 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:56.477093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:56.477703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:56.484412 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:56.484918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:56.485368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:56.486032 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:56.486491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:56.486919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:56.504708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:38:56.623085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:56.632784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-280b70ae-3646-42f9-b70f-bb04da61c298 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.158910 Aug 08 17:38:56.638431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2163/3484] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:56 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:57.492774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:57.493954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:57.501114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:57.501604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:57.502072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:57.502769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:57.503226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:57.503645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:57.563903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:57.571382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce7f9316-1484-4ce5-b6e8-12be10849462 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1209 microversion: 2.1 time: 0.082553 Aug 08 17:38:57.571945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2164/3485] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:57 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:57.657264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:57.657909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:57.663820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:57.664325 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:57.664755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:57.665435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:57.665914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:57.666337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:57.795883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:57.803771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-434c357e-c897-4433-b60a-bb9745223220 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1724 microversion: 2.1 time: 0.151086 Aug 08 17:38:57.804331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2165/3486] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:57 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:58.591984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:58.592641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:58.599503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:58.600243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:58.600839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:58.601616 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:58.602108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:58.602712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:58.666802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:58.675138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-65891da2-f1b5-461a-bfe9-512a24f290f4 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1283 microversion: 2.1 time: 0.086962 Aug 08 17:38:58.675710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2166/3487] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:58 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:58.824645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:58.825291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:58.831592 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:58.838971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:58.838971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:58.838971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:58.838971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:58.839283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:58.971534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:58.980198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-88b59027-52df-4733-96b0-e48e2a52307a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1701 microversion: 2.1 time: 0.159249 Aug 08 17:38:58.980893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2167/3488] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:58 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:59.001826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:59.008235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.008817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.009319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.032699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Going to try to start instance {{(pid=130501) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 17:38:59.182040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bbe6ef00-a813-4e1a-8dbd-6d31f3c6a077 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.184386 Aug 08 17:38:59.182659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2168/3489] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:38:58 2022] POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:38:59.190991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:59.191690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:59.198372 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.198927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.199484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.200183 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.200634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.201051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.343788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:59.348096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8e44b381-3372-47ae-93b9-5c0fdd59ea1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1710 microversion: 2.1 time: 0.161131 Aug 08 17:38:59.363129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2169/3490] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:59 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:38:59.468993 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:38:59.471646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:59.478654 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.479147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.479583 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.480278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.480730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.481153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.720449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-50b823e3-2d8d-44e1-b227-f44271111ddb tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action" status: 202 len: 0 microversion: 2.1 time: 0.255854 Aug 08 17:38:59.721528 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2170/3491] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:38:59 2022] POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:38:59.727523 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:59.729861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:59.735961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.736257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.736694 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.737926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.738396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.738813 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.892073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:38:59.899568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-12c5d49b-a419-428c-90e5-720e213d152b tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.176872 Aug 08 17:38:59.908259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2171/3492] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:59 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:38:59.908259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:38:59.908259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:38:59.914727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.915223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.915770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:38:59.916480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:38:59.916980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:38:59.917427 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:00.143141 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:00.151334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-060af64a-c687-4c08-857c-adcb08f4f3a6 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1750 microversion: 2.1 time: 0.250229 Aug 08 17:39:00.152199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2172/3493] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:38:59 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1750 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:00.370746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:00.371614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:00.378096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:00.378584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:00.386817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:00.386817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:00.386817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:00.386817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:00.563415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:00.572104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ca3c40c2-3aef-409c-8d95-b05fdf4a7ef7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1710 microversion: 2.1 time: 0.205398 Aug 08 17:39:00.572757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2173/3494] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:00 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:00.620104 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b103d5c-b284-4af5-804e-3e317d82f018", "tag": "36f30c9c-250c-4cf4-8806-a94a7fd05f7a"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:00.630913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:00.631392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:00.631823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:00.643504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] Creating event network-changed:36f30c9c-250c-4cf4-8806-a94a7fd05f7a for instance 4b103d5c-b284-4af5-804e-3e317d82f018 on hv-cinder-85221 Aug 08 17:39:00.649857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-8ce63dc2-e808-4df9-a55d-2320e5c77a3b req-352fcc01-9b4c-495e-bec1-7c111d9010d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033001 Aug 08 17:39:00.650918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2174/3495] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:39:00.922323 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:00.923222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:00.929342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:00.929897 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:00.930333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:00.931010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:00.931459 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:00.931878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:01.094922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:01.102725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1336a678-6e40-4036-ac99-b1bdbc5c80a0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.185936 Aug 08 17:39:01.103290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2175/3496] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:00 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:01.171843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:01.172493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:01.178268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:01.178746 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:01.179180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:01.179856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:01.180300 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:01.180743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:01.324782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:01.333318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-45e7d7be-0306-482e-adb1-cd9a802af610 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.165207 Aug 08 17:39:01.333893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2176/3497] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:01 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:01.593541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:01.594286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:01.600495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:01.600976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:01.601411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:01.602153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:01.602604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:01.603022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:01.814984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:01.822893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb4bf6fe-40b0-43df-af29-49e8a8f0615a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1714 microversion: 2.1 time: 0.233310 Aug 08 17:39:01.823455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2177/3498] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:01 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1714 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:02.125770 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:02.126603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:02.133270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:02.134043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:02.134361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:02.135121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:02.135997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:02.136245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:02.580763 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:02.584450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:02.589316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bc0b69c0-b677-42dc-be60-00d8ab9770d0 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.469331 Aug 08 17:39:02.597219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2178/3499] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:02 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:02.597219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:02.597219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:02.603257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:02.603898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:02.604328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:02.605077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:02.605531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:02.605985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:02.774212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:02.782942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6df7d22d-95b2-44d4-8cdf-e4f7c48297f9 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.192096 Aug 08 17:39:02.783516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2179/3500] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:02 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:03.610519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:03.611132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:03.617078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:03.617560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:03.618033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:03.618721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:03.619172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:03.619595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:03.744848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:03.752382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f585d5f6-8677-4a16-b488-ce34a34708bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.146261 Aug 08 17:39:03.752949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2180/3501] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:03 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:03.803588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:03.804200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:03.809969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:03.810453 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:03.810920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:03.811600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:03.812057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:03.812474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:03.952062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:03.959891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aa9eb6d8-6030-4e05-83bc-e8db9859a9ad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.159841 Aug 08 17:39:03.960450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2181/3502] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:03 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:04.772604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:04.773219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:04.779692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:04.780180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:04.780619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:04.781303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:04.781755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:04.782318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:04.910263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:04.917627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d4087215-9ac1-43bd-9aa7-0cf9cdf667ab tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.148887 Aug 08 17:39:04.918222 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2182/3503] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:04 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:04.983783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:04.984397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:04.990454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:04.990934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:04.991365 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:04.992052 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:04.992500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:04.992918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:05.137198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:05.145094 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-04b39768-1fc5-47aa-8229-83323423f8f3 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.165663 Aug 08 17:39:05.145650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2183/3504] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:04 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:05.939174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:05.939708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:05.946014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:05.946492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:05.946933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:05.947608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:05.948055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:05.948474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:06.075056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:06.083008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-883a6251-cc8b-465c-aa48-36bef0709a9e tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.148195 Aug 08 17:39:06.083575 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2184/3505] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:05 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:06.166310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:06.166949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:06.172709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:06.173191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:06.173626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:06.174329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:06.174783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:06.175225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:06.249029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:06.319705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:06.328000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c7f43b0b-6a90-40e1-9de3-07bfd0aa6629 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.165567 Aug 08 17:39:06.328567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2185/3506] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:06 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:07.103422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:07.104031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:07.106186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:07.111524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:07.112001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:07.112435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:07.113129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:07.113571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:07.114018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:07.251403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:07.259853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0a6e6e18-01e6-43af-b361-c38091f539f5 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.159500 Aug 08 17:39:07.259853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2186/3507] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:07 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:07.264490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b103d5c-b284-4af5-804e-3e317d82f018", "name": "network-vif-plugged", "status": "completed", "tag": "36f30c9c-250c-4cf4-8806-a94a7fd05f7a"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:07.273442 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:07.273978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:07.274395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:07.285705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] Creating event network-vif-plugged:36f30c9c-250c-4cf4-8806-a94a7fd05f7a for instance 4b103d5c-b284-4af5-804e-3e317d82f018 on hv-cinder-85221 Aug 08 17:39:07.290344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-c2bc5705-03fd-48cc-bbef-b6d37b3528df req-0055e668-3246-4dfe-8da7-db942f82359f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Aug 08 17:39:07.290949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2187/3508] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:39:07.349884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:07.350582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:07.357539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:07.358276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:07.360398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:07.360398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:07.360595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:07.361153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:07.511385 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:07.520048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-36b0f393-be97-44e8-99fe-1d2ec7c3cdce tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.174701 Aug 08 17:39:07.520614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2188/3509] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:07 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:08.279997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:08.280635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:08.287853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:08.288711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:08.289156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:08.289870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:08.290324 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:08.290747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:08.417096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:08.425048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-42626363-270d-4f61-897f-ccd3364d076c tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.149367 Aug 08 17:39:08.425607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2189/3510] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:08 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:08.540566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:08.541101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:08.546908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:08.547391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:08.547830 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:08.548510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:08.548966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:08.549386 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:08.693517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:08.702105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-80d39988-32b7-484d-a36a-87b6f8ba178f tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.164513 Aug 08 17:39:08.703093 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2190/3511] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:08 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:09.445060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:09.445703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:09.452065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:09.452541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:09.452972 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:09.453646 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:09.454571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:09.454991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:09.518792 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:39:09.519397 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:39:09.582471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:09.590303 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d04909d1-2d3d-44be-a25b-449978a492cb tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1313 microversion: 2.1 time: 0.148911 Aug 08 17:39:09.599831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2191/3512] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:09 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:09.725243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:09.725923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:09.731974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:09.732455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:09.732885 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:09.734138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:09.734750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:09.735169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:09.876888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:09.885101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-37d1959a-c1dd-4443-9bdc-e731896ce445 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.164428 Aug 08 17:39:09.885664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2192/3513] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:09 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:10.611305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:10.611933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:10.618439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:10.618917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:10.619344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:10.620020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:10.620467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:10.620887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:10.754374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:10.761721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-56e4ac01-4552-4f9c-8313-257450d8bfe6 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1497 microversion: 2.1 time: 0.154233 Aug 08 17:39:10.762304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2193/3514] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:10 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:10.906113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:10.906751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:10.912595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:10.913069 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:10.913534 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:10.914235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:10.914687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:10.915109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:11.058083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:11.066686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ce0b13a9-7d71-41a3-a554-91e8cb7c83be tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.164485 Aug 08 17:39:11.067263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2194/3515] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:10 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:11.642911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:11.643488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:11.649698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:11.651519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:11.651519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:11.651519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:11.651825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:11.652118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:11.676573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:39:11.689638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:12.024342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fb61b301-482c-46c1-870c-6c71a0add524 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 204 len: 0 microversion: 2.1 time: 0.385408 Aug 08 17:39:12.024922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2195/3516] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:39:11 2022] DELETE /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:39:12.033403 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:12.034135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:12.035974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:12.041524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:12.044476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:12.044476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:12.044476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:12.044476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:12.044790 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:12.175925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:12.183268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f6e3f600-1e1e-4404-9800-005d443c4733 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1503 microversion: 2.1 time: 0.153828 Aug 08 17:39:12.183823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2196/3517] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:12 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:12.190179 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:12.190933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:12.196725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:12.197203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:12.197634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:12.198337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:12.198794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:12.199216 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:12.346619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:12.354919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c16f7f84-eeda-4f07-bc7f-a8d98e6d12cf tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.168833 Aug 08 17:39:12.355480 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2197/3518] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:12 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:13.204969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:13.205587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:13.212041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:13.212468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:13.212908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:13.213597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:13.214098 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:13.214514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:13.341283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:13.349817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bad36506-f43b-470b-a513-73d0c499e1bf tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1503 microversion: 2.1 time: 0.149210 Aug 08 17:39:13.350387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2198/3519] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:13 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:13.376413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:13.377047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:13.382785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:13.383269 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:13.383705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:13.384395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:13.384854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:13.385283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:13.531988 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:13.540151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e81b4e2e-69ab-4a73-bb48-94ac6c39586a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.167819 Aug 08 17:39:13.540717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2199/3520] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:13 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:14.371084 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:14.371749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:14.378675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:14.379280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:14.379586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:14.380274 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:14.380728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:14.381151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:14.585446 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:14.595151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-88d47fd1-82a0-4390-a7bd-34806fb4b844 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1503 microversion: 2.1 time: 0.225994 Aug 08 17:39:14.606400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2200/3521] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:14 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:14.612908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:14.613827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:14.620306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:14.620792 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:14.621226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:14.621947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:14.622402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:14.622829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:14.830040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:14.839602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-225ff24f-1b4b-4419-81bd-81f4209b954c tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.231552 Aug 08 17:39:14.840213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2201/3522] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:14 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:14.887212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b103d5c-b284-4af5-804e-3e317d82f018", "name": "network-vif-deleted", "tag": "36f30c9c-250c-4cf4-8806-a94a7fd05f7a"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:14.896947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:14.899466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:14.899466 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:14.910065 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] Creating event network-vif-deleted:36f30c9c-250c-4cf4-8806-a94a7fd05f7a for instance 4b103d5c-b284-4af5-804e-3e317d82f018 on hv-cinder-85221 Aug 08 17:39:14.914699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-6da537d2-7e87-427d-972e-c0a577715be0 req-26675c9e-77b5-4aca-8f57-678f6eeb1c90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031324 Aug 08 17:39:14.916868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2202/3523] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:39:15.619438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:15.620131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:15.626805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:15.627287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:15.627724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:15.628404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:15.628876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:15.629281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:15.659519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:15.659997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:15.660430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:15.660875 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lazy-loading 'fault' on Instance uuid 4b103d5c-b284-4af5-804e-3e317d82f018 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:39:15.707757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be82c73106c48fa83ab08e96ecbfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a87a1912d31432eaa11f28865ca7d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:15.715275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3f5f4813-37b7-40d1-b669-6b6923e8a229 tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 200 len: 1303 microversion: 2.1 time: 0.100473 Aug 08 17:39:15.715833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2203/3524] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:15 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:15.861152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:15.861683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:15.867658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:15.868090 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:15.868526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:15.869204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:15.869659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:15.870107 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:16.018243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:16.023744 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6ad74478-348f-4675-a5d3-eb5665850a94 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.166523 Aug 08 17:39:16.024295 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2204/3525] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:15 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:16.736221 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:16.736853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] [instance: 4b103d5c-b284-4af5-804e-3e317d82f018] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:16.742868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:16.743346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:16.743772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:16.744443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:16.744889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:16.745305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:16.758341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] HTTP exception thrown: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Request method failure captured: Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 HTTP/1.1 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UoaXUX9QV5XDyVxDZciwDj6x9xAvSJO2gz4Rkt2yxtXjg2FMIUuANfS1p4pKrPmK7xiGdOLwM7cnIG8QrGgOFjPX1Ha4TdxtD_qVROiQ6rpwAs66lnNE7nB80x_4VJj2e1JIuRb-I6Y_S1EDilON91X6qjK1VAgOb6d6heV-kwNnF8 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 2a87a1912d31432eaa11f28865ca7d98 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesActionsTest-392539050 Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:39:16.759926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a87a1912d31432eaa11f28865ca7d98", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a87a1912d31432eaa11f28865ca7d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesActionsTest-392539050 Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 2a87a1912d31432eaa11f28865ca7d98 Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesActionsTest-392539050 Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesActionsTest-392539050-project Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 3be82c73106c48fa83ab08e96ecbfe81 Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesActionsTest-392539050-project Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. Aug 08 17:39:16.761160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '4b103d5c-b284-4af5-804e-3e317d82f018'} Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:39:16.761781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. Aug 08 17:39:16.762863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:39:16.763768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] Returning 404 to user: Instance 4b103d5c-b284-4af5-804e-3e317d82f018 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:39:16.763768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b9b7fdf-0936-4a10-b0b9-2e5c1b8b2ffd tempest-VolumesActionsTest-392539050 tempest-VolumesActionsTest-392539050-project] 10.222.0.57 "GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018" status: 404 len: 111 microversion: 2.1 time: 0.028949 Aug 08 17:39:16.763768 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2205/3526] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:16 2022] GET /compute/v2.1/servers/4b103d5c-b284-4af5-804e-3e317d82f018 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:39:17.044314 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:17.044930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:17.051799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:17.051799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:17.057344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:17.057344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:17.057344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:17.057344 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:17.206474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:17.214625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d9a05866-7cc2-41f1-aa43-cd6291ec1d73 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1755 microversion: 2.1 time: 0.174134 Aug 08 17:39:17.215186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2206/3527] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:17 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:18.235803 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:18.236452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:18.242864 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:18.243345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:18.243782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:18.244463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:18.244916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:18.245338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:18.382685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:18.390545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-720f144b-e8b3-4c0b-9260-3ad737478209 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1758 microversion: 2.1 time: 0.158586 Aug 08 17:39:18.391105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2207/3528] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:18 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:45.713929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-642120611", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:45.721638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=25 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:45.722328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:45.766898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] validate_networks() for None {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:39:46.035827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:39:46.036248 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:39:46.036717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:39:46.037125 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:39:46.037533 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:39:46.046046 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:46.046517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:46.046946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:46.047652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:46.048100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:46.048516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:46.066674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Getting quotas for project 16e69a5645214463a9c76a02903f0f3c. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:39:46.070544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Getting quotas for user 7f6251b0292243bf87df290fdaa5673b and project 16e69a5645214463a9c76a02903f0f3c. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:39:46.081091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:39:46.083332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:39:46.236565 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-11cdb3ff-6c4d-44e8-8ac3-7daba20d4ea8 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526244 Aug 08 17:39:46.237356 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2208/3529] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:39:46.248272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b9c75f20-43ec-430b-b17d-28b2391f1b84 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:46.248886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b9c75f20-43ec-430b-b17d-28b2391f1b84 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:46.301923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b9c75f20-43ec-430b-b17d-28b2391f1b84 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:46.308645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b9c75f20-43ec-430b-b17d-28b2391f1b84 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1214 microversion: 2.1 time: 0.064257 Aug 08 17:39:46.309214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2209/3530] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:46 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:47.328496 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:47.329182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:47.336849 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:47.337347 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:47.337757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:47.338478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:47.338927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:47.339351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:47.402142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:47.409489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-26711bcd-937d-4e33-b885-88a8ce4664d0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1218 microversion: 2.1 time: 0.084902 Aug 08 17:39:47.410083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2210/3531] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:47 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:48.430243 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:48.431672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:48.438820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:48.439305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:48.439742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:48.440425 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:48.440905 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:48.441328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:48.545268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:48.554057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-24055bf9-42e7-4b90-b514-dc10d45f3125 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1274 microversion: 2.1 time: 0.127582 Aug 08 17:39:48.554638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2211/3532] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:48 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:49.574876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:49.575484 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:49.582411 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:49.582932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:49.584047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:49.584909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:49.585367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:49.585819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:49.798067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:49.806134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e7152fa-547f-414b-9b6e-9dc33a199c63 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.235178 Aug 08 17:39:49.806686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2212/3533] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:49 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:50.474794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d", "tag": "a8d96566-13b6-4d5b-8b23-14f5f6ce4155"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:50.484031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:50.484515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:50.485025 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:50.495675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] Creating event network-changed:a8d96566-13b6-4d5b-8b23-14f5f6ce4155 for instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d on hv-cinder-85221 Aug 08 17:39:50.500529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-b2ddd095-3ee2-4134-85c2-08b0ab566a17 req-3d689b49-90ba-49fb-97f8-ce4df146c2c8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030253 Aug 08 17:39:50.501245 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2213/3534] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:39:50.828959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:50.829600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:50.836400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:50.836891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:50.837358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:50.838086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:50.838549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:50.839006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:51.045170 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:51.052829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-60bf061d-7cec-419c-83ab-b6fdded618f0 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.228847 Aug 08 17:39:51.053395 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2214/3535] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:50 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:51.058306 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:51.058818 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:51.064504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:51.064996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:51.065438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:51.066169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:51.066632 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:51.067064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:51.153020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lazy-loading 'services' on Instance uuid 70ff2375-7d4e-4267-b9c6-f59f74409e1c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:39:51.343240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8a82ccb8-e57e-40d2-a9b9-8bf60a72a996 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments/10da34f6-9560-466a-afc7-ff4dae0c80ad" status: 202 len: 0 microversion: 2.1 time: 0.288386 Aug 08 17:39:51.343825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2215/3536] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:39:51 2022] DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments/10da34f6-9560-466a-afc7-ff4dae0c80ad => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:39:52.074968 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:52.075698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:52.081777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:52.082284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:52.082715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:52.083933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:52.084383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:52.084806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:52.219801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:52.227476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6bd4db6a-d302-4fee-b083-0e9f87cbe63f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.157144 Aug 08 17:39:52.228035 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2216/3537] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:52 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:53.247552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:53.248161 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:53.254567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:53.255055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:53.255500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:53.256242 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:53.256705 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:53.257137 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:53.395678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:53.404472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6fa0f5c0-648c-4c34-a703-947862ff6598 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.160753 Aug 08 17:39:53.405360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2217/3538] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:53 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:53.520031 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:53.526553 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:53.527059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:53.527490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:53.549336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Going to try to stop instance {{(pid=130501) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 17:39:53.718549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-07dbfaea-8056-4250-b9e3-77d7e5d6ed4a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.202421 Aug 08 17:39:53.719168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2218/3539] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:39:53 2022] POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:39:53.727712 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:53.730937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:53.734542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:53.735027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:53.735460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:53.736146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:53.736601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:53.737023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:53.865256 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:53.872675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-35389511-e44c-439e-8890-4692b5f26788 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.149137 Aug 08 17:39:53.873333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2219/3540] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:53 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:54.426240 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:54.426920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:54.433650 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:54.434544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:54.434686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:54.435313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:54.435772 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:54.436223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:54.565401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:54.572766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-58a98f0e-204e-487f-bf26-a728bb9a7a47 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.150683 Aug 08 17:39:54.573336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2220/3541] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:54 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:54.895012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:54.895626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:54.901974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:54.902458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:54.902895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:54.903606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:54.904061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:54.904493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:55.034719 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:55.043290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-77b5c65f-815a-465d-a553-6a4fda73a56c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.152198 Aug 08 17:39:55.043844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2221/3542] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:54 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:55.389003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d", "name": "network-vif-plugged", "status": "completed", "tag": "a8d96566-13b6-4d5b-8b23-14f5f6ce4155"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:55.399277 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:55.399757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:55.400186 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:55.410917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] Creating event network-vif-plugged:a8d96566-13b6-4d5b-8b23-14f5f6ce4155 for instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d on hv-cinder-85221 Aug 08 17:39:55.415973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-b373e312-6c42-414b-bac9-b21c636e3629 req-20d0ddda-6b93-4929-b635-1a9fec8a46f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 Aug 08 17:39:55.416631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2222/3543] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:39:55.592996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:55.593767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:55.600815 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:55.601290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:55.601718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:55.602423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:55.602876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:55.603293 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:55.736601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:55.744485 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8229d2db-ee57-4216-9d6d-764c75326d7a tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.155823 Aug 08 17:39:55.745043 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2223/3544] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:55 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:56.064142 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:56.064729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:56.066693 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:56.071454 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:56.071937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:56.072373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:56.073047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:56.073497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:56.073950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:56.200285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:56.207725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-791e0448-2e9e-40a5-b084-1b72874b3264 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.147530 Aug 08 17:39:56.208284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2224/3545] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:56 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:56.767271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:56.767898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:56.769732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:56.775608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:56.777994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:56.777994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:56.777994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:56.777994 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:56.778392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:56.909942 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:56.913318 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:39:56.917618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3e7979fc-f55f-4c7f-90ee-774110ee2b4c tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1314 microversion: 2.1 time: 0.154197 Aug 08 17:39:56.918204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2225/3546] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:56 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:57.077644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-221135120"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:57.078202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:57.084420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.084938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.085368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.086064 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.086517 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.086970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.211508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.network.security_group_api [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Removing security group 42b049c6-76fd-4967-9192-f1369d0b2a93 from port bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 Aug 08 17:39:57.568619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9ece4555-1d44-463b-95b9-113d3583d949 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action" status: 202 len: 0 microversion: 2.1 time: 0.490706 Aug 08 17:39:57.568619 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2226/3547] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:39:57 2022] POST /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:39:57.569765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:57.570489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:57.576764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.577252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.577692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.578415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.578869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.579302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.770869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:57.779878 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-63742e26-19cf-4e20-806d-1328a71c0a6d tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.214115 Aug 08 17:39:57.780450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2227/3548] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:57 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:57.785027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:57.797396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.797909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.798343 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.809767 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] Creating event network-changed:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:39:57.815076 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-99e9fd71-a5ed-4820-91f5-b7c55b01d066 req-65d16be5-2cc8-4805-a8bb-262a13a4ebd4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033361 Aug 08 17:39:57.815808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2228/3549] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:39:57.938708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:57.939423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:57.945777 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.946287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.946724 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:57.947413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:57.947862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:57.948282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.270584 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:58.278605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-53606689-8ab0-47ba-aa69-e7694a004e43 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1464 microversion: 2.1 time: 0.344065 Aug 08 17:39:58.279182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2229/3550] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:57 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:58.326457 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:58.326962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:58.332983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.333452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.333923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.334615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.335068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.336158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.361924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:39:58.628115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4652716c-9178-4d75-a0a7-6444e43c3825 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 204 len: 0 microversion: 2.1 time: 0.302061 Aug 08 17:39:58.628115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2230/3551] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:39:58 2022] DELETE /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:39:58.634569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:58.635265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:58.641136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.641626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.642110 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.642799 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.643253 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.643682 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.862374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:58.870429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-979fc212-36c9-4b55-8fcf-ba616840ba8f tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1470 microversion: 2.1 time: 0.240446 Aug 08 17:39:58.870998 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2231/3552] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:58 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:39:58.875493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:58.876278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:58.881953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.882947 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.883404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:58.884096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:58.884624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:58.885050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.106657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:39:59.114053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5b999f80-d882-4fe5-a0c0-f013e1242386 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.242090 Aug 08 17:39:59.114622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2232/3553] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:58 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:39:59.275853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:59.276359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:59.282329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.282820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.283319 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.284016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.284472 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.284898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.366683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lazy-loading 'services' on Instance uuid c29c0189-7397-45de-be34-70edf23ee404 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:39:59.578366 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4eaf9ed3-eac2-450f-80f9-d5feaa3ed97a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments/7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f" status: 202 len: 0 microversion: 2.1 time: 0.306814 Aug 08 17:39:59.578976 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2233/3554] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:39:59 2022] DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments/7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:39:59.594604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:59.594833 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:59.602332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.602831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.603313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.603990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.604447 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.604876 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.634769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ad688df5-f519-4498-8f55-a88713144321 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051207 Aug 08 17:39:59.635561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2234/3555] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:39:59 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:39:59.830600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:39:59.844448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.844448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.844448 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.853312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] Creating event network-changed:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:39:59.858122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-8441a405-8645-4427-97d5-a97750d389bf req-9926935a-c49e-4c51-9b3d-bdc585fd14b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031210 Aug 08 17:39:59.858711 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2235/3556] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:39:59.895977 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:39:59.896680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:39:59.903429 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.903918 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.904362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:39:59.905085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:39:59.905541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:39:59.905999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:00.041208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:00.048969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7a3069c0-091f-4390-a2d7-280a2b46de6e tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1470 microversion: 2.1 time: 0.157541 Aug 08 17:40:00.049557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2236/3557] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:39:59 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:40:00.135992 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:00.136642 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:00.142906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:00.143393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:00.144014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:00.144706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:00.145168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:00.145591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:00.576621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:00.584009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e2c1e722-0953-4c19-9c84-fc03a26964a9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.452581 Aug 08 17:40:00.584766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2237/3558] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:00 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:00.647327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:00.649488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:00.655408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:00.655890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:00.656322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:00.657009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:00.658136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:00.658136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:00.690697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-51b2350e-dae4-4f48-ae18-a9039f8cd58d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Aug 08 17:40:00.691589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2238/3559] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:40:00 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:40:01.072020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:01.074353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:01.088931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.091205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.092400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.093861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.094333 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.094761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.169145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6251b0292243bf87df290fdaa5673b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e69a5645214463a9c76a02903f0f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:01.176979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-342dc31a-1f7f-4a36-b0f6-6aea3e5225c4 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 200 len: 1428 microversion: 2.1 time: 0.110345 Aug 08 17:40:01.181978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2239/3560] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:01 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:01.182635 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d", "name": "network-vif-deleted", "tag": "a8d96566-13b6-4d5b-8b23-14f5f6ce4155"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:01.192055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.192530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.192986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.204991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] Creating event network-vif-deleted:a8d96566-13b6-4d5b-8b23-14f5f6ce4155 for instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d on hv-cinder-85221 Aug 08 17:40:01.210099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-0324e958-518b-4ef9-a37d-fea97d91a89f req-53e9f202-faa1-4cfe-ab7c-89ca4b105ebf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 Aug 08 17:40:01.210877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2240/3561] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:01.605341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:01.606124 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:01.612358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.616135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.616135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.616135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.616135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.616966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.746526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:01.753965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8a4783c5-b0a3-4a72-b946-84668723ee1a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.152953 Aug 08 17:40:01.754518 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2241/3562] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:01 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:01.759468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:01.761586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:01.767128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.767606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.768040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.768722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.769173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.769594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.785741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:01.797054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c7550825-67ea-4355-a405-d769433f5571 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041574 Aug 08 17:40:01.797585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2242/3563] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:40:01 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:40:01.807806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:01.808320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:01.813846 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.814329 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.814765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.815439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:01.815893 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:01.816315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:01.889398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] HTTP exception thrown: Instance c29c0189-7397-45de-be34-70edf23ee404 is not attached to volume 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Request method failure captured: Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments/7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f HTTP/1.1 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnZS-7d56gtfArW5RfYDLHgm16wP6mQPUWWqw9J8xd58NHX4MUfejEe9GowzQ5JwqQvcy08YwOGfoel_DEYVH5E9rtPgkWuVPY1I0f_0KcRLdBlcW4izQq6zK4Cy2tWQCPztd3zb95zjZyrQPOnJacs2mOq1Ui51a7IIwLxPgB4Afc Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: f8b25b8f45c84feb869633ea4ee98521 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:40:01.897610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f8b25b8f45c84feb869633ea4ee98521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: f8b25b8f45c84feb869633ea4ee98521 Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestMinimumBasicScenario-92681106-project Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 640d1ecc20f54d81945ba6003787ebc7 Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestMinimumBasicScenario-92681106-project Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:40:01.898943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance c29c0189-7397-45de-be34-70edf23ee404 is not attached to volume 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'server_id': 'c29c0189-7397-45de-be34-70edf23ee404', 'id': '7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f'} Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f. Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:40:01.899536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29c0189-7397-45de-be34-70edf23ee404 is not attached to volume 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29c0189-7397-45de-be34-70edf23ee404 is not attached to volume 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:01.900620 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Returning 404 to user: Instance c29c0189-7397-45de-be34-70edf23ee404 is not attached to volume 7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:40:01.901566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-96900ea1-f76f-4b52-8e12-3cbe048232ee tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments/7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f" status: 404 len: 154 microversion: 2.1 time: 0.095447 Aug 08 17:40:01.901566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2243/3564] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:40:01 2022] DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404/os-volume_attachments/7bb0e625-9ac5-45a4-acf7-3fdb94e0fc6f => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:40:02.199310 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:02.199924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] [instance: cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:02.206440 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:02.206920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:02.207355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:02.208045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:02.208503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:02.208926 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:02.224358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] HTTP exception thrown: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Request method failure captured: Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d HTTP/1.1 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8Upfq4k-XqLdHYW3qnT4cO4BrHyIrCpD7d_ksbQu2Ej_9krIqFf6G7CZOBf12VKPw52KpNzIM5Q9Vp83i6mnHHyJMc0nyT1DIhzXRovJRpCmCAEbEiIXwUvADEXb2t0usV514VvGHW3QoYx_KZffky_WlXT-yLs5rF1Dctw2tvXJmS0 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 16e69a5645214463a9c76a02903f0f3c Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-VolumesNegativeTest-1425680461 Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:40:02.226692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_16e69a5645214463a9c76a02903f0f3c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/16e69a5645214463a9c76a02903f0f3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/16e69a5645214463a9c76a02903f0f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/16e69a5645214463a9c76a02903f0f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-VolumesNegativeTest-1425680461 Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 16e69a5645214463a9c76a02903f0f3c Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-VolumesNegativeTest-1425680461 Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-VolumesNegativeTest-1425680461-project Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 7f6251b0292243bf87df290fdaa5673b Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-VolumesNegativeTest-1425680461-project Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. Aug 08 17:40:02.227996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d'} Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:40:02.228624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. Aug 08 17:40:02.229663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:02.231230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] Returning 404 to user: Instance cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:40:02.231230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5e58ffaa-1f8d-4e2c-942e-db39a1b62b69 tempest-VolumesNegativeTest-1425680461 tempest-VolumesNegativeTest-1425680461-project] 10.222.0.57 "GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d" status: 404 len: 111 microversion: 2.1 time: 0.033764 Aug 08 17:40:02.231230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2244/3565] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:02 2022] GET /compute/v2.1/servers/cb7750e4-c7f8-48d6-9fd0-dfdf8ef4cf9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:40:02.776147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:02.776797 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:02.782898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:02.783382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:02.785597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:02.785597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:02.785597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:02.785597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:02.917165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:02.924634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0c8ac75e-7bc5-4296-8b13-9f14fa19e19e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.152922 Aug 08 17:40:02.925236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2245/3566] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:02 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:40:03.221491 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:03.222105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:03.225605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:03.228951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.229415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.229868 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:03.230550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.230999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.231416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:03.258741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:40:03.572990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a7b7eb6a-0814-4184-aa44-e67255fc819d tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 204 len: 0 microversion: 2.1 time: 0.355075 Aug 08 17:40:03.573578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2246/3567] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:40:03 2022] DELETE /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:40:03.581938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:03.582674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:03.590055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.590549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.590989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:03.591689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.592177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.592605 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:03.721825 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:03.729883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c918393b-d366-46a9-b49b-1e65815e6cd0 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1554 microversion: 2.1 time: 0.152000 Aug 08 17:40:03.730434 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2247/3568] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:03 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:03.945099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:03.945638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:03.951641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.952123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.952559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:03.953268 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:03.953766 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:03.954219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:04.086311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:04.093958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-427e6b3a-a400-4d38-9093-a3331521f4a3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.152773 Aug 08 17:40:04.094522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2248/3569] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:03 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:04.751618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:04.752215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:04.759794 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:04.760419 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:04.760904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:04.761610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:04.762129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:04.762563 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:04.897823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:04.905304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6ad29c7-374d-4804-985e-7d2677dbeaad tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1554 microversion: 2.1 time: 0.158067 Aug 08 17:40:04.906207 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2249/3570] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:04 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:05.116381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:05.117561 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:05.123438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:05.123917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:05.124387 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:05.125088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:05.125537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:05.125985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:05.260751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:05.268266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-eb863dc0-0b1b-4bec-ac90-ca79646b163b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1678 microversion: 2.1 time: 0.155688 Aug 08 17:40:05.268786 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2250/3571] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:05 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:05.931884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:05.931884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:05.935623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:05.936432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:05.936934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:05.937709 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:05.938368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:05.938907 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.068291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:06.076804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b732ade0-885c-4709-ada1-0926f38191df tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1554 microversion: 2.1 time: 0.153917 Aug 08 17:40:06.077273 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2251/3572] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:05 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:06.190933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29c0189-7397-45de-be34-70edf23ee404", "name": "network-vif-deleted", "tag": "bae51d3c-3929-4a2b-aae2-fadfc0edd4b6"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:06.202393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.209282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.209282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.215979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] Creating event network-vif-deleted:bae51d3c-3929-4a2b-aae2-fadfc0edd4b6 for instance c29c0189-7397-45de-be34-70edf23ee404 on hv-cinder-85221 Aug 08 17:40:06.220722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-0f540c43-3a64-4e4b-adcc-b9577183aaf7 req-e2868a4c-2308-4b5a-b520-f0ca8e0b3a2a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034174 Aug 08 17:40:06.221308 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2252/3573] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:40:06.292219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:06.293067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:06.302889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.302889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.302889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.303890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.304572 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.305155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.449192 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:06.457078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-adacce49-9365-4e60-813e-5f75f314f3d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1655 microversion: 2.1 time: 0.170433 Aug 08 17:40:06.457545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2253/3574] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:06 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1655 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:06.478674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:06.484943 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.485512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.486056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.509690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Going to try to start instance {{(pid=130501) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 17:40:06.667219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0b589b2c-73f6-4391-8bfb-485ad29dd07e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.192426 Aug 08 17:40:06.667817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2254/3575] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Aug 8 17:40:06 2022] POST /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:40:06.676160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:06.676858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:06.683138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.683623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.684089 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.684775 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:06.685235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:06.685664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:06.819362 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:06.827532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1ba27e62-a750-4da8-9c2a-63296dce0716 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1664 microversion: 2.1 time: 0.155432 Aug 08 17:40:06.828114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2255/3576] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:06 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:07.104779 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:07.105471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:07.111747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:07.112233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:07.112672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:07.113400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:07.113881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:07.114307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:07.145294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:07.145771 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:07.146236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:07.146683 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lazy-loading 'fault' on Instance uuid c29c0189-7397-45de-be34-70edf23ee404 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:40:07.187913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640d1ecc20f54d81945ba6003787ebc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b25b8f45c84feb869633ea4ee98521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:07.197200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4e0fd9a7-2f16-461e-9519-b4cb5125e17a tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 200 len: 1348 microversion: 2.1 time: 0.096224 Aug 08 17:40:07.197810 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2256/3577] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:07 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:07.848051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:07.848858 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:07.855393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:07.855881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:07.856320 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:07.857005 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:07.857460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:07.857917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:07.875604 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:07.990380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:07.997760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7f77ed29-d198-4d2f-9969-82960b5a43ab tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1664 microversion: 2.1 time: 0.153637 Aug 08 17:40:07.998334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2257/3578] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:07 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:08.219490 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:08.220132 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] [instance: c29c0189-7397-45de-be34-70edf23ee404] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:08.227150 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:08.227662 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:08.228101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:08.228980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:08.229458 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:08.229899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:08.244971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] HTTP exception thrown: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Request method failure captured: Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 HTTP/1.1 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnZS-7d56gtfArW5RfYDLHgm16wP6mQPUWWqw9J8xd58NHX4MUfejEe9GowzQ5JwqQvcy08YwOGfoel_DEYVH5E9rtPgkWuVPY1I0f_0KcRLdBlcW4izQq6zK4Cy2tWQCPztd3zb95zjZyrQPOnJacs2mOq1Ui51a7IIwLxPgB4Afc Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: f8b25b8f45c84feb869633ea4ee98521 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:40:08.246645 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f8b25b8f45c84feb869633ea4ee98521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f8b25b8f45c84feb869633ea4ee98521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: f8b25b8f45c84feb869633ea4ee98521 Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestMinimumBasicScenario-92681106 Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestMinimumBasicScenario-92681106-project Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 640d1ecc20f54d81945ba6003787ebc7 Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestMinimumBasicScenario-92681106-project Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. Aug 08 17:40:08.248057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'c29c0189-7397-45de-be34-70edf23ee404'} Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:40:08.248896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. Aug 08 17:40:08.250231 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:08.251195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Returning 404 to user: Instance c29c0189-7397-45de-be34-70edf23ee404 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:40:08.251195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-707da6dd-07a7-4ab0-9e0f-d9f3279064db tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404" status: 404 len: 111 microversion: 2.1 time: 0.032758 Aug 08 17:40:08.251195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2258/3579] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:08 2022] GET /compute/v2.1/servers/c29c0189-7397-45de-be34-70edf23ee404 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:40:08.256995 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-295fc811-9d7a-4c8f-870a-297b39bf5b80 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] Calling method '.version_select at 0x7f743d14f280>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:08.334544 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-295fc811-9d7a-4c8f-870a-297b39bf5b80 tempest-TestMinimumBasicScenario-92681106 tempest-TestMinimumBasicScenario-92681106-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939733450" status: 202 len: 0 microversion: 2.1 time: 0.081029 Aug 08 17:40:08.335130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2259/3580] 10.222.0.57 () {58 vars in 1269 bytes} [Mon Aug 8 17:40:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939733450 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:40:09.019055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:09.019759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:09.026342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:09.026873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:09.027312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:09.028003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:09.028462 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:09.028888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:09.160870 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:09.169349 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-647aed71-fa58-4bf8-bd1c-367a5e643aac tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1668 microversion: 2.1 time: 0.154230 Aug 08 17:40:09.169922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2260/3581] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:09 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:21.623394 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:40:21.623865 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:40:25.481910 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:40:25.482589 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:40:31.426259 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:31.426756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:31.429296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:31.430045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=10 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:31.434595 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:31.435077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:31.435508 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:31.436689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:31.437139 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:31.437586 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:31.462252 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:40:31.853580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b6a43d8f-410a-4a90-b7b0-32e0cfb53c0a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 204 len: 0 microversion: 2.1 time: 0.431192 Aug 08 17:40:31.854205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2261/3582] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:40:31 2022] DELETE /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:40:31.863210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:31.863910 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:31.869914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:31.870401 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:31.870842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:31.871530 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:31.871984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:31.872408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:32.009398 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:32.016971 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e9b9d90-2826-41eb-a851-d4c59e4f53e9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1577 microversion: 2.1 time: 0.157879 Aug 08 17:40:32.017537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2262/3583] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:31 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:40:33.038271 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:33.038887 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:33.045367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:33.045908 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:33.046377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:33.047054 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:33.047505 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:33.047923 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:33.175034 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:33.182438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-b1d0b90f-d8b9-43c8-8001-0ea140b14b9c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1577 microversion: 2.1 time: 0.148052 Aug 08 17:40:33.183003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2263/3584] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:33 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:34.204359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:34.205053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:34.211413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:34.211965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:34.212404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:34.213086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:34.213541 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:34.213983 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:34.345727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:34.353590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb5c4ab1-5201-4b00-b0f1-8be8b30f4da9 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1577 microversion: 2.1 time: 0.153610 Aug 08 17:40:34.354181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2264/3585] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:34 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:34.880884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bddccb-7316-4a1c-a94a-10307d7e6a33", "name": "network-vif-deleted", "tag": "d8421b6c-a857-435e-b350-ee15ba0d8699"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:34.890388 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:34.893131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:34.893131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:34.902580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] Creating event network-vif-deleted:d8421b6c-a857-435e-b350-ee15ba0d8699 for instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 on hv-cinder-85221 Aug 08 17:40:34.907460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-9e7f41b6-a837-438e-8026-a769a89848de req-f73b6a3a-b853-42ca-90e0-176e32c45f90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Aug 08 17:40:34.908285 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2265/3586] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:35.375702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:35.376461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:35.383246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:35.383725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:35.384160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:35.384840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:35.385291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:35.385713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:35.452909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:35.460522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a68c7d71-def3-4fee-999a-610574c53177 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 200 len: 1225 microversion: 2.1 time: 0.089508 Aug 08 17:40:35.461617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2266/3587] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:35 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:36.481392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:36.482095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:36.488980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:36.489467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:36.489945 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:36.490660 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:36.491117 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:36.491547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:36.505055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] HTTP exception thrown: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Request method failure captured: Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 HTTP/1.1 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnHOjTTvb7KOFSdLLh-xOgUHScbjaR7OxpPt12LBWQvLgE4VcbE1X3jD6mtoUZJ5M8zw3BMh7MAniXkfHTiuhBinv2y1Fu39ALp4Rv0ZUwD-7Ipwfbax61-UK5hlTg3QKVU8jLOfrwJknEyHVmXKf5dNl9zrdH_EjUvA-6ke2Qh8Eg Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:40:36.506732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f857768418e43d8bdbab85be767b896", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f857768418e43d8bdbab85be767b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 57662358169d4830b2ebb7d594efb701 Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:40:36.508114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'f8bddccb-7316-4a1c-a94a-10307d7e6a33'} Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:40:36.508969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:40:36.510391 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:36.511548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Returning 404 to user: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:40:36.511548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-90547541-9e71-425f-9e45-d865efe7f31e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 404 len: 111 microversion: 2.1 time: 0.030699 Aug 08 17:40:36.511548 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2267/3588] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:36 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:40:36.606543 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-180238056", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174986336", "security_groups": [{"name": "tempest-secgroup-smoke-1459570141"}], "block_device_mapping_v2": [{"uuid": "a78af51d-b450-4f05-ac7f-0d31d93d47ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "400b4c68-3dad-4d25-a628-ab8745ed4a6f"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:36.715843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] validate_networks() for [('400b4c68-3dad-4d25-a628-ab8745ed4a6f', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:40:37.312856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:40:37.313276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:40:37.313752 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:40:37.314187 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:40:37.314597 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:40:37.323229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:37.323704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:37.324135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:37.324840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:37.325287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:37.325704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:37.342762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:40:37.346625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for user 57662358169d4830b2ebb7d594efb701 and project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:40:37.403382 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:40:37.405573 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a78af51d-b450-4f05-ac7f-0d31d93d47ac',volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:40:37.752330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-86b9d546-8499-418b-a6c4-80be99be7748 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.149583 Aug 08 17:40:37.753254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2268/3589] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:40:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:40:37.763623 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-05a54e4e-acb1-4e91-9737-8ea40be547f3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:37.764241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-05a54e4e-acb1-4e91-9737-8ea40be547f3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:37.816932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-05a54e4e-acb1-4e91-9737-8ea40be547f3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:37.823618 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-05a54e4e-acb1-4e91-9737-8ea40be547f3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1094 microversion: 2.1 time: 0.063719 Aug 08 17:40:37.824181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2269/3590] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:37 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:38.843891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:38.844638 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:38.851155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:38.855640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:38.855640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:38.855640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:38.855640 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:38.855964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:39.115542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:39.123195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a6029c4c-8924-4abc-9cee-8ca51e104fa1 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1144 microversion: 2.1 time: 0.283760 Aug 08 17:40:39.123764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2270/3591] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:38 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1144 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:40.143954 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:40.144566 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:40.151739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:40.152223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:40.156903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:40.156903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:40.156903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:40.156903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:40.221000 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:40.228593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-38da9089-b265-46c9-89f5-0776c0e3fcc3 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1210 microversion: 2.1 time: 0.089012 Aug 08 17:40:40.229145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2271/3592] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:40 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:41.250789 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:41.251578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:41.258492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:41.259872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:41.259872 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:41.260354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:41.260819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:41.261254 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:41.399266 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:41.406809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-973185cd-2210-4174-a7ce-731e4430c9ff tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1278 microversion: 2.1 time: 0.160575 Aug 08 17:40:41.407377 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2272/3593] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:41 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:41.487537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922b5083-289e-40f5-86d3-692e536efee2", "tag": "bcdc4c06-3696-4acd-8a14-f7e93921b2cd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:41.496862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:41.509229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:41.509229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:41.509229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] Creating event network-changed:bcdc4c06-3696-4acd-8a14-f7e93921b2cd for instance 922b5083-289e-40f5-86d3-692e536efee2 on hv-cinder-85221 Aug 08 17:40:41.513857 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-034e8518-d39d-4852-9e76-b2dd4887f845 req-3cf6a160-ebf5-4f4d-b816-e1a98981d1a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029846 Aug 08 17:40:41.514539 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2273/3594] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:42.401622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:42.403873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:42.410238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.410725 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.411159 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.411855 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.412304 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.412722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.444113 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7b6bdbc3-fd34-44fe-9172-0d5ea6869b89 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047230 Aug 08 17:40:42.444679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2274/3595] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:40:42 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 17:40:42.449174 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:42.449773 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:42.455891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.456378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.456809 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.457489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.457964 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.458430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.596936 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:42.604785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aed53710-6f0a-4c9f-ad58-843d51da3150 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.159125 Aug 08 17:40:42.605342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2275/3596] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:42 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:40:42.609754 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:42.610278 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:42.615808 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.616292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.616726 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.617399 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.617869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.618288 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.643743 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:40:42.904503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-146d65b1-333c-4008-bd21-c545e6af45cb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 204 len: 0 microversion: 2.1 time: 0.297786 Aug 08 17:40:42.905020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2276/3597] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:40:42 2022] DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:40:42.913357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:42.914330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:42.920027 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.920511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.920948 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:42.921639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:42.922130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:42.922554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:43.058406 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:43.062417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:43.066837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6d7d353a-9f39-446d-9b75-5265895693be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1674 microversion: 2.1 time: 0.157532 Aug 08 17:40:43.067402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2277/3598] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:42 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:43.626750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:43.627364 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:43.634063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:43.634547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:43.634985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:43.635666 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:43.636120 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:43.636546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:43.766934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:43.774272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8e4eb56c-e793-402e-9a55-cb66042ecd74 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.151910 Aug 08 17:40:43.774823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2278/3599] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:43 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:44.087934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:44.088536 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:44.095131 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:44.095607 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:44.096038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:44.096718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:44.097169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:44.097588 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:44.227838 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:44.235392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a98495b4-2df0-4cbb-9c27-6f2a85a343d9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1674 microversion: 2.1 time: 0.151274 Aug 08 17:40:44.235957 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2279/3600] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:44 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:44.795450 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:44.796087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:44.802408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:44.802891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:44.803326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:44.804009 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:44.804463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:44.804884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:44.933173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:44.940676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-bda40a4e-187e-42b0-97d8-8de4bad8a6db tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.149580 Aug 08 17:40:44.941263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2280/3601] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:44 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:45.256482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:45.257085 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:45.262938 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:45.263421 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:45.264337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:45.265014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:45.266514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:45.266514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:45.400311 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:45.407133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-4cc740cc-a70d-4611-a6ad-7624f9d72682 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1674 microversion: 2.1 time: 0.154517 Aug 08 17:40:45.407703 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2281/3602] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:45 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:45.960669 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:45.961327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:45.968220 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:45.968708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:45.969147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:45.969863 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:45.970321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:45.970742 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:46.108337 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:46.115888 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-abc9cdc6-8e5c-4011-b492-4518fe9c3caf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.159162 Aug 08 17:40:46.116461 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2282/3603] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:45 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:46.123465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ff2375-7d4e-4267-b9c6-f59f74409e1c", "name": "network-vif-deleted", "tag": "ad0fc363-c342-459d-a322-5b0b813a673c"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:46.132731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:46.133223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:46.133659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:46.147851 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] Creating event network-vif-deleted:ad0fc363-c342-459d-a322-5b0b813a673c for instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c on hv-cinder-85221 Aug 08 17:40:46.152895 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-7206b509-86df-45fa-b183-476a95b9483a req-84ce786b-0ab8-4f33-8e41-a41d1adad479 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Aug 08 17:40:46.153501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2283/3604] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:46.429078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:46.429909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:46.436287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:46.436862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:46.437363 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:46.438143 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:46.438598 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:46.439058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:46.470836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:46.471426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:46.471953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:46.472473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lazy-loading 'fault' on Instance uuid 70ff2375-7d4e-4267-b9c6-f59f74409e1c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:40:46.520379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:46.528410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d627a8b3-4e3c-4e01-900f-9d7b10a77fe3 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 200 len: 1328 microversion: 2.1 time: 0.103406 Aug 08 17:40:46.529655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2284/3605] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:46 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:47.135915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:47.136576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:47.143332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:47.143896 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:47.144431 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:47.145197 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:47.145721 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:47.146244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:47.282671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:47.290055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1e55b4a2-66e6-42ae-8939-6d93734a3631 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.158167 Aug 08 17:40:47.290615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2285/3606] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:47 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:47.555482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:47.556096 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:47.558068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:47.563962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:47.564441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:47.564877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:47.565560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:47.566045 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:47.566471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:47.579784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c HTTP/1.1 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:40:47.581969 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:40:47.583486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '70ff2375-7d4e-4267-b9c6-f59f74409e1c'} Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:40:47.584264 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:40:47.585510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:40:47.586651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:40:47.586651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3800aec1-ff73-4612-ac34-6ade0ef5c531 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 404 len: 111 microversion: 2.1 time: 0.031121 Aug 08 17:40:47.586651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2286/3607] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:47 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:40:47.591397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-81d5fbb1-8361-4ffb-a437-ee59b39923c8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '.version_select at 0x7f74388f64c0>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:47.704136 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-81d5fbb1-8361-4ffb-a437-ee59b39923c8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070252123" status: 202 len: 0 microversion: 2.1 time: 0.116341 Aug 08 17:40:47.704702 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2287/3608] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Aug 8 17:40:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070252123 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:40:48.307129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:48.311053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:48.311728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:48.318355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:48.318861 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:48.319426 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:48.320049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:48.320498 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:48.320916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:48.461958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:48.474393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-94337b63-2844-46b6-98ce-6fae52b246bf tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.168052 Aug 08 17:40:48.474967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2288/3609] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:48 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:48.485869 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-da9c1ddc-5cb7-4a68-8e5e-379e7ff5bef0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: .version_select at 0x7f743cff7430>, body: {"keypair": {"name": "tempest-keypair-1189588743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXH+KK6lACYELQ3fyjuAOFMuWxzqyOzBEcdQETOZwmlznLH9qlrtKFCyxH/NVGLf+lwlFoLzAQXBaB2k0BcqIY/x4bLGx1fetD+eFSll8wC/+oHR9P2x4mK8k2Ny6hPxA=="}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:48.494633 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-da9c1ddc-5cb7-4a68-8e5e-379e7ff5bef0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for project e449345a18254a1ab181cbbcfafa33c8. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:40:48.498503 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-da9c1ddc-5cb7-4a68-8e5e-379e7ff5bef0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for user 054f2a730eaa4a32b11f4a731c687094 and project e449345a18254a1ab181cbbcfafa33c8. Resources: {'key_pairs'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:40:48.507430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:48.572793 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-da9c1ddc-5cb7-4a68-8e5e-379e7ff5bef0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096818 Aug 08 17:40:48.573415 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2289/3610] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Aug 8 17:40:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:49.494615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:49.495272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:49.504213 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:49.504708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:49.505145 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:49.506189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:49.506556 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:49.506987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:49.651404 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:49.659692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9234c5bf-64a6-4646-b941-44d5f4645dee tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.169252 Aug 08 17:40:49.660251 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2290/3611] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:49 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:50.680554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:50.681167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:50.688788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:50.689281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:50.689722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:50.693940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:50.693940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:50.693940 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:50.823686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:50.831160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6fffe6b1-35ce-426b-b10e-f1a753bfe643 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.154510 Aug 08 17:40:50.831731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2291/3612] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:50 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:50.836500 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-281438131", "imageRef": "1492361c-9cf9-4aae-9c98-22a73c7406ca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64c0f3e2-9863-4a7b-846c-017265c5dd63"}], "security_groups": [{"name": "tempest-securitygroup--3824830"}], "key_name": "tempest-keypair-1189588743", "user_data": "}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:50.941720 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] validate_networks() for [('64c0f3e2-9863-4a7b-846c-017265c5dd63', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:40:51.307602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:40:51.308059 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:40:51.308540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:40:51.308953 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:40:51.309369 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:40:51.318236 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:51.318716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:51.319151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:51.319873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:51.320327 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:51.320750 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:51.337341 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for project e449345a18254a1ab181cbbcfafa33c8. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:40:51.342165 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Getting quotas for user 054f2a730eaa4a32b11f4a731c687094 and project e449345a18254a1ab181cbbcfafa33c8. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:40:51.353414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:40:51.355722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1492361c-9cf9-4aae-9c98-22a73c7406ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:40:51.479571 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-3c1b2156-60cc-4f2f-915f-317d4ebe269a tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.646800 Aug 08 17:40:51.480396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2292/3613] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:40:50 2022] POST /compute/v2.1/servers => generated 399 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:40:51.490871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d2df85b8-616c-4f11-b97d-b8b2e3390047 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:51.491839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d2df85b8-616c-4f11-b97d-b8b2e3390047 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:51.545844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-d2df85b8-616c-4f11-b97d-b8b2e3390047 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:51.553134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d2df85b8-616c-4f11-b97d-b8b2e3390047 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1237 microversion: 2.1 time: 0.066095 Aug 08 17:40:51.553698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2293/3614] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:51 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:51.730727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922b5083-289e-40f5-86d3-692e536efee2", "name": "network-vif-plugged", "status": "completed", "tag": "bcdc4c06-3696-4acd-8a14-f7e93921b2cd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:51.740527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:51.741063 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:51.745824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:51.752681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] Creating event network-vif-plugged:bcdc4c06-3696-4acd-8a14-f7e93921b2cd for instance 922b5083-289e-40f5-86d3-692e536efee2 on hv-cinder-85221 Aug 08 17:40:51.757522 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-f288444c-3785-4c27-81b6-39a40383da7b req-27b204f7-d3c3-44e3-88ed-d14e77a9cc0b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Aug 08 17:40:51.758217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2294/3615] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:40:51.853112 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:51.853835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:51.859997 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:51.861041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:51.861488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:51.862235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:51.862690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:51.863116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:52.001762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:52.009275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-67dca050-f5e0-4b4a-aa37-77c268c9489e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.160415 Aug 08 17:40:52.009853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2295/3616] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:51 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:52.574041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:52.574577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:52.580601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:52.581077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:52.581512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:52.582228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:52.582690 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:52.583115 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:52.648736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:52.656531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6e3b8f58-b41f-4dc0-9010-f1a465647450 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1241 microversion: 2.1 time: 0.086501 Aug 08 17:40:52.657091 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2296/3617] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:52 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:53.030430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:53.031073 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:53.037467 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:53.038057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:53.038499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:53.039184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:53.039637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:53.040062 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:53.174748 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:53.182291 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8de619e7-87f7-4cfc-a1ce-ecd3f1edd783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1266 microversion: 2.1 time: 0.156472 Aug 08 17:40:53.182856 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2297/3618] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:53 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:53.676890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:53.677560 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:53.683550 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:53.684033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:53.684473 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:53.685154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:53.686172 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:53.686600 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:53.747593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:53.755678 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6fce15a6-7ece-4b87-a194-63db127d5eb4 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1289 microversion: 2.1 time: 0.082676 Aug 08 17:40:53.756238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2298/3619] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:53 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:54.204116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:54.204765 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:54.211205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.211695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.212140 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.212832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.213292 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.213716 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.354260 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:54.357890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:40:54.364037 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ededfcb7-f4ec-441b-9fe1-39dbe67c82fd tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1452 microversion: 2.1 time: 0.164099 Aug 08 17:40:54.364149 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2299/3620] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:54 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:54.383249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:54.383853 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:54.391685 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.392783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.392783 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.393452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.393933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.394360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.532078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:54.539841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2a52c616-7bf3-4c66-89d6-56ec17388e23 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1452 microversion: 2.1 time: 0.160583 Aug 08 17:40:54.540576 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2300/3621] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:54 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:54.776569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:54.777699 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:54.784397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.785151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.786932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.786932 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:54.787191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:54.788122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:54.881156 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:54.892020 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b487a4a-3178-4429-a74f-f070616c4ab6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1295 microversion: 2.1 time: 0.119348 Aug 08 17:40:54.892952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2301/3622] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:54 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:55.915474 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:55.916238 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:55.923456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:55.924078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:55.924524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:55.925217 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:55.925672 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:55.926126 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:56.132636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:56.141630 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-5bd4634f-b827-458f-baed-d10c47f41b08 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.231405 Aug 08 17:40:56.142956 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2302/3623] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:55 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:40:56.148360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d0dc986-d516-4f32-bbf2-8308da44ba07", "tag": "c16530a3-f5e5-44f7-bb1f-913b91fe7f88"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:56.162410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:56.162680 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:56.163111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:56.175086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] Creating event network-changed:c16530a3-f5e5-44f7-bb1f-913b91fe7f88 for instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 on hv-cinder-85221 Aug 08 17:40:56.180151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-86e11394-73fa-4ad8-b76d-95e5f797d2b1 req-5ab31c6e-03b6-469a-a890-d035edb0cd0e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035704 Aug 08 17:40:56.180753 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2303/3624] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:40:56.683919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922b5083-289e-40f5-86d3-692e536efee2", "tag": "bcdc4c06-3696-4acd-8a14-f7e93921b2cd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:40:56.696452 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:56.697307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:56.698134 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:56.710925 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] Creating event network-changed:bcdc4c06-3696-4acd-8a14-f7e93921b2cd for instance 922b5083-289e-40f5-86d3-692e536efee2 on hv-cinder-85221 Aug 08 17:40:56.715675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-4c0c6ee9-99d5-4ae5-9473-af04bdf3f3b3 req-b8267fe7-d497-4f75-85d5-5b61d73ab9d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Aug 08 17:40:56.721601 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2304/3625] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:40:57.165652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:57.166648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:57.173038 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:57.173529 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:57.174023 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:57.174731 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:57.175190 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:57.175852 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:57.312281 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:57.319759 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e702c7a5-8673-4e00-bac5-976fbbaffad0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.158854 Aug 08 17:40:57.320322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2305/3626] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:57 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:58.340307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:58.340934 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:58.348168 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:58.348648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:58.349080 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:58.349760 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:58.350250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:58.350674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:58.480676 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:58.488081 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2e5c3c0e-8941-40b1-a850-eff8b3a2efe9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.151658 Aug 08 17:40:58.488637 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2306/3627] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:58 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:40:59.508991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:40:59.509717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:40:59.516644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:59.517129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:59.517568 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:59.518510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:40:59.518732 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:40:59.519154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:40:59.648481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:40:59.656757 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-1abc0daa-d21e-42ad-9f47-046cb9af87b8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.151587 Aug 08 17:40:59.657778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2307/3628] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:40:59 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:41:00.676423 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:00.685617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:00.685617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:00.685617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:00.685617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:00.685984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:00.685984 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:00.686146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:00.817099 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:41:00.824567 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8aa39c3-8188-4ff8-b905-cfb9e841f638 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.152073 Aug 08 17:41:00.825129 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2308/3629] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:41:00 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:41:01.769526 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0dc986-d516-4f32-bbf2-8308da44ba07", "name": "network-vif-plugged", "status": "completed", "tag": "c16530a3-f5e5-44f7-bb1f-913b91fe7f88"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:41:01.772332 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:41:01.773111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=12 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:41:01.778749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:01.779228 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:01.779657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:01.791109 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] Creating event network-vif-plugged:c16530a3-f5e5-44f7-bb1f-913b91fe7f88 for instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 on hv-cinder-85221 Aug 08 17:41:01.795845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-65a4c491-4433-41f8-a254-51a3a41c6697 req-67c1b468-fd49-47cd-8208-9b8f135c8745 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Aug 08 17:41:01.796445 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2309/3630] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:01.847414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:01.848299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:01.854432 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:01.854917 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:01.855359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:01.856075 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:01.856527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:01.856951 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:01.989657 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:41:01.997696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-10c4587a-06f3-4ee2-9caa-f6617bedd267 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.155031 Aug 08 17:41:01.998330 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2310/3631] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:41:01 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:41:03.019044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:03.019656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:03.026313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:03.026820 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:03.027257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:03.027941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:03.028394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:03.028814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:03.154558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:41:03.161949 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c57805cd-839f-4d50-aa94-7ac5e2416df9 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1360 microversion: 2.1 time: 0.147537 Aug 08 17:41:03.162512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2311/3632] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:41:03 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:41:04.182737 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:04.183410 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:04.189802 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:04.190298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:04.190736 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:04.191416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:04.191931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:04.192357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:04.318339 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:41:04.325609 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7faa31eb-7ae5-4367-ae2c-ffda262b47a2 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1546 microversion: 2.1 time: 0.146778 Aug 08 17:41:04.326191 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2312/3633] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:41:04 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:41:04.347305 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:04.348050 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:04.353727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:04.354232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:04.354667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:04.355338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:04.355785 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:04.356204 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:04.436051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e23ff060-f6ed-45f7-87fa-ef21baf41515 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092277 Aug 08 17:41:04.436665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2313/3634] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Aug 8 17:41:04 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:05.648577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d0dc986-d516-4f32-bbf2-8308da44ba07", "tag": "c16530a3-f5e5-44f7-bb1f-913b91fe7f88"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:41:05.658438 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:05.658916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:05.659342 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:05.670019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] Creating event network-changed:c16530a3-f5e5-44f7-bb1f-913b91fe7f88 for instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 on hv-cinder-85221 Aug 08 17:41:05.676033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-673474a8-c3d9-414b-be23-1c94e9e3061e req-db606953-2181-4499-aa8d-44383a5eef54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031051 Aug 08 17:41:05.676624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2314/3635] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:41:41.850805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:41.851443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:41.853594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:41:41.854263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=72 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:41:41.859057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:41.859545 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:41.859980 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:41.861218 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:41.861671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:41.862122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:41.884021 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2119523c-8176-4c82-9a3e-a8f5365664b7 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/ips" status: 200 len: 145 microversion: 2.1 time: 0.037873 Aug 08 17:41:41.884578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2315/3636] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Aug 8 17:41:41 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:43.533829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "842dc870-b8e6-4f5a-96bd-2d086b240087"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:41:43.537036 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:43.543862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:43.544338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:43.544769 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:43.545443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:43.545922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:43.546345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:44.371284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6a45b413-5159-4f71-b167-6b9e2b952cbb tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841851 Aug 08 17:41:44.371960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2316/3637] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:41:43 2022] POST /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:52.937158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:52.940118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:52.946477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:52.946973 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:52.947414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:52.948105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:52.948558 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:52.949003 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:52.978299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ed02ca26-1baa-4856-92e5-6cc06a672976 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046164 Aug 08 17:41:52.978842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2317/3638] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:41:52 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:52.989322 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:41:52.989829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:52.995436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:52.996182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:52.996402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:52.997095 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:52.997551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:52.998002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:53.025042 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-df12245b-aba9-4df2-8e26-56dcc374d984 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087" status: 200 len: 194 microversion: 2.1 time: 0.039888 Aug 08 17:41:53.025602 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2318/3639] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Aug 8 17:41:52 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:41:54.615102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a5fb6fa-cb1c-4cfc-99fb-405a51bbd978"}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:41:54.617396 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:41:54.623747 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:54.624230 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:54.624665 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:54.625340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:41:54.625819 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:41:54.626233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:41:55.408435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f21792a8-b77a-49a8-95d6-86e765064ae8 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "POST /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797553 Aug 08 17:41:55.409040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2319/3640] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Aug 8 17:41:54 2022] POST /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:03.975263 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:03.977478 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:03.983591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:03.984079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:03.984514 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:03.985195 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:03.985648 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:03.986101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:04.016671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-afb34547-f31d-479e-91b7-24557cf573f5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046586 Aug 08 17:42:04.017212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2320/3641] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:42:03 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:04.157879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:04.158287 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:04.164103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:04.164580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:04.165010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:04.165684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:04.166157 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:04.166580 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:04.194755 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cb841847-31db-4200-b453-b63c5f3974a0 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087" status: 200 len: 194 microversion: 2.1 time: 0.040826 Aug 08 17:42:04.195302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2321/3642] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Aug 8 17:42:04 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:04.204684 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:04.205167 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:04.210674 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:04.211147 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:04.211578 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:04.212244 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:04.212689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:04.213106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:04.291845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lazy-loading 'services' on Instance uuid 2d0dc986-d516-4f32-bbf2-8308da44ba07 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:42:04.486482 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-d3b0e9cd-05dd-4ea0-ad00-9f3be3849b90 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087" status: 202 len: 0 microversion: 2.1 time: 0.285012 Aug 08 17:42:04.487181 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2322/3643] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:42:04 2022] DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/842dc870-b8e6-4f5a-96bd-2d086b240087 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:42:06.660921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:06.661525 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:06.667634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:06.668116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:06.668554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:06.669235 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:06.669688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:06.670152 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:06.697730 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-370421d7-62b4-4bdb-ba0c-10ffa5d85442 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/8a5fb6fa-cb1c-4cfc-99fb-405a51bbd978" status: 200 len: 194 microversion: 2.1 time: 0.041524 Aug 08 17:42:06.698313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2323/3644] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Aug 8 17:42:06 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/8a5fb6fa-cb1c-4cfc-99fb-405a51bbd978 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:06.708614 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:06.709102 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:06.714643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:06.715122 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:06.715559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:06.716233 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:06.716686 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:06.717111 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:06.793436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lazy-loading 'services' on Instance uuid 2d0dc986-d516-4f32-bbf2-8308da44ba07 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:42:07.011557 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-6858ac04-1357-4619-b1bf-2406994df472 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/8a5fb6fa-cb1c-4cfc-99fb-405a51bbd978" status: 202 len: 0 microversion: 2.1 time: 0.306897 Aug 08 17:42:07.012138 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2324/3645] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Aug 8 17:42:06 2022] DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments/8a5fb6fa-cb1c-4cfc-99fb-405a51bbd978 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:42:08.180728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:08.183070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:08.189408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.189930 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.190371 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.191542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.191996 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.192422 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.221033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f90a59ca-83a5-432e-b9b3-77a09291e483 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045089 Aug 08 17:42:08.221577 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2325/3646] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:42:08 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 17:42:08.341477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:08.341477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:08.341477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.341477 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.341959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.341959 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.342338 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.342756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.370738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-159fd265-8934-41d6-a21a-dea8e9fe78be tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042331 Aug 08 17:42:08.371280 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2326/3647] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Aug 8 17:42:08 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 17:42:08.432049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:08.432551 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:08.438443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.438922 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.439360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.440040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.440494 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.441527 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.465133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:42:08.467848 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:08.732762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-fcffe55d-104a-4d19-b1b8-72d84005462b tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 204 len: 0 microversion: 2.1 time: 0.304179 Aug 08 17:42:08.733354 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2327/3648] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:42:08 2022] DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:42:08.742313 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:08.743008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:08.748873 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.749345 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.749804 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.750504 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:08.750970 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:08.751400 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:08.881966 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:08.889512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-56c061ee-7432-4d4f-9219-e1ef2efa268c tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1670 microversion: 2.1 time: 0.151799 Aug 08 17:42:08.890106 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2328/3649] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:08 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:09.961169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:09.965212 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:09.968146 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:09.968624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:09.969060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:09.969735 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:09.970367 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:09.970840 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:10.098283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:10.105687 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8692d322-a659-4c79-a47e-bd53e0412361 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1670 microversion: 2.1 time: 0.199558 Aug 08 17:42:10.106270 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2329/3650] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:09 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1670 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:11.126564 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:11.127214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:11.133538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:11.134056 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:11.134499 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:11.135188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:11.135643 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:11.136068 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:11.362701 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:11.370355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7503931a-1316-417c-9bef-ac7596781e31 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1670 microversion: 2.1 time: 0.247566 Aug 08 17:42:11.370958 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2330/3651] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:11 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:12.014751 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0dc986-d516-4f32-bbf2-8308da44ba07", "name": "network-vif-deleted", "tag": "c16530a3-f5e5-44f7-bb1f-913b91fe7f88"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:42:12.024223 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:12.029435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:12.029435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:12.036465 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] Creating event network-vif-deleted:c16530a3-f5e5-44f7-bb1f-913b91fe7f88 for instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 on hv-cinder-85221 Aug 08 17:42:12.041294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-37a220a4-fbc5-4d5f-8d57-c9ecd2680fd8 req-0b50e734-37b1-47b4-b04b-2bd5b857f8a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Aug 08 17:42:12.043133 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2331/3652] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:12.391891 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:12.392502 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:12.398931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:12.399414 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:12.401902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:12.401902 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:12.402208 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:12.403041 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:12.436424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:12.436937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:12.437397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:12.437834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lazy-loading 'fault' on Instance uuid 2d0dc986-d516-4f32-bbf2-8308da44ba07 {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:42:12.481158 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '054f2a730eaa4a32b11f4a731c687094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e449345a18254a1ab181cbbcfafa33c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:12.490350 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-cd9d201d-3eab-4d7a-9bab-afda20f9c1ed tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 200 len: 1327 microversion: 2.1 time: 0.103155 Aug 08 17:42:12.491088 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2332/3653] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:12 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:13.511471 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:13.512086 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:13.518606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:13.519723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:13.520155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:13.520839 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:13.521290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:13.521708 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:13.534904 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 HTTP/1.1 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:42:13.536510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:13.537982 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '2d0dc986-d516-4f32-bbf2-8308da44ba07'} Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:42:13.538696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:13.539987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:13.541249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:42:13.541249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-8b03bb38-11fc-4e9c-b6a2-2ab9a4be1292 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 404 len: 111 microversion: 2.1 time: 0.030261 Aug 08 17:42:13.541249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2333/3654] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:13 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:42:13.545991 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-452283d6-de8e-49f8-847c-858fb8684c33 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '.version_select at 0x7f743d02c430>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:13.628105 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-452283d6-de8e-49f8-847c-858fb8684c33 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189588743" status: 202 len: 0 microversion: 2.1 time: 0.085339 Aug 08 17:42:13.629348 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2334/3655] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Aug 8 17:42:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1189588743 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:42:17.250460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:17.250999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:17.252871 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:17.258439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:17.258924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:17.259361 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:17.260048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:17.260507 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:17.260933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:17.274173 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 HTTP/1.1 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:42:17.275692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.277048 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '2d0dc986-d516-4f32-bbf2-8308da44ba07'} Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:42:17.277915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.279154 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.280417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:42:17.280417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-ecabfb3c-1af2-40ea-b648-1dfd189f3c1e tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 404 len: 111 microversion: 2.1 time: 0.031168 Aug 08 17:42:17.280417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2335/3656] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:42:17 2022] DELETE /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:42:17.285058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:17.285655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 2d0dc986-d516-4f32-bbf2-8308da44ba07] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:17.292435 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:17.292913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:17.293346 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:17.294070 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:17.300008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:17.300008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:17.307610 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 HTTP/1.1 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:42:17.309123 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.310497 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '2d0dc986-d516-4f32-bbf2-8308da44ba07'} Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:42:17.311384 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. Aug 08 17:42:17.312679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:17.313886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 2d0dc986-d516-4f32-bbf2-8308da44ba07 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:42:17.313886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-21ecaec7-ab24-4bd0-8a53-fd2b64383c92 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07" status: 404 len: 111 microversion: 2.1 time: 0.028797 Aug 08 17:42:17.313886 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2336/3657] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:17 2022] GET /compute/v2.1/servers/2d0dc986-d516-4f32-bbf2-8308da44ba07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:42:18.602051 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:18.602617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:18.609402 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:18.609914 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:18.610355 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:18.611057 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:18.611495 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:18.611920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:18.625663 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c HTTP/1.1 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:42:18.627850 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.629265 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '70ff2375-7d4e-4267-b9c6-f59f74409e1c'} Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:42:18.630018 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.631357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.632608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:42:18.632608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-09a704cf-7de2-4168-82b5-493454b698e5 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 404 len: 111 microversion: 2.1 time: 0.031589 Aug 08 17:42:18.632608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2337/3658] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:42:18 2022] DELETE /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:42:18.636944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:18.637542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] [instance: 70ff2375-7d4e-4267-b9c6-f59f74409e1c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:18.643055 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:18.643540 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:18.643975 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:18.644651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:18.645103 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:18.645524 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:18.659100 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] HTTP exception thrown: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Request method failure captured: Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c HTTP/1.1 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnF3KKh-XQFJAx9tv-9o7ZaSas_uNGLX6HMI7pJ1a_qrCyIuq87CwbrqbJOIgD6sPbHBQ-_Lc_RbZ0ZqxryARFmhxhPwoLau4c8xG2JqBNgPE9j39OKMitHfsY8E_kwjsUsjq5TQS6HUAGU7bMhEH0BB1HzvFZW_DP9kQOUQquzQK4 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:42:18.660641 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e449345a18254a1ab181cbbcfafa33c8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e449345a18254a1ab181cbbcfafa33c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: e449345a18254a1ab181cbbcfafa33c8 Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2089753988 Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 054f2a730eaa4a32b11f4a731c687094 Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-AttachVolumeTestJSON-2089753988-project Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.662067 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '70ff2375-7d4e-4267-b9c6-f59f74409e1c'} Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:42:18.663373 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. Aug 08 17:42:18.664656 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:42:18.665843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] Returning 404 to user: Instance 70ff2375-7d4e-4267-b9c6-f59f74409e1c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:42:18.665843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f74c35c1-c83c-4194-ac6a-ca07cc2830b6 tempest-AttachVolumeTestJSON-2089753988 tempest-AttachVolumeTestJSON-2089753988-project] 10.222.0.57 "GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c" status: 404 len: 111 microversion: 2.1 time: 0.028453 Aug 08 17:42:18.665843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2338/3659] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:18 2022] GET /compute/v2.1/servers/70ff2375-7d4e-4267-b9c6-f59f74409e1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:42:29.527772 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:42:29.528320 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:42:42.134374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1199232742", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174986336", "security_groups": [{"name": "tempest-secgroup-smoke-1459570141"}], "block_device_mapping_v2": [{"uuid": "947a543c-f631-4bf8-bab7-6d5791492291", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "400b4c68-3dad-4d25-a628-ab8745ed4a6f"}]}} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:42:42.144681 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=7 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:42.145312 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:42.249417 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.network.neutron [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] validate_networks() for [('400b4c68-3dad-4d25-a628-ab8745ed4a6f', None, None, None, None, None)] {{(pid=130501) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:42:42.607290 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:42:42.607717 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image limits 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:42:42.608232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Flavor pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:42:42.608639 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Image pref 0:0:0 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:42:42.609074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.virt.hardware [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:42:42.617979 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:42.618460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:42.618898 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:42.619615 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:42.620066 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:42.620486 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:42.638845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:42:42.642844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.quota [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Getting quotas for user 57662358169d4830b2ebb7d594efb701 and project 0f857768418e43d8bdbab85be767b896. Resources: {'cores', 'ram', 'instances'} {{(pid=130501) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:42:42.703407 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Going to run 1 instances... {{(pid=130501) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:42:42.705481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='947a543c-f631-4bf8-bab7-6d5791492291',volume_size=None,volume_type=None)] {{(pid=130501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:42:43.130328 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7cccad89-0811-4aef-8da0-39869eeddc47 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999653 Aug 08 17:42:43.130974 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2339/3660] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Aug 8 17:42:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 17:42:43.142353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e75a316a-6423-4285-b52a-6323e711bfe6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:43.143016 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e75a316a-6423-4285-b52a-6323e711bfe6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:43.198889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-e75a316a-6423-4285-b52a-6323e711bfe6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:43.206554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e75a316a-6423-4285-b52a-6323e711bfe6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1095 microversion: 2.1 time: 0.066899 Aug 08 17:42:43.206554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2340/3661] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:43 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:44.225298 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:44.225950 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:44.232962 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:44.233475 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:44.233937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:44.234628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:44.235083 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:44.235509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:44.295933 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:44.303315 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-10a66d51-7910-4fd2-80d2-58221e01177e tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1145 microversion: 2.1 time: 0.082247 Aug 08 17:42:44.303884 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2341/3662] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:44 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:45.323874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:45.324531 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:45.331512 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:45.332006 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:45.332437 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:45.333128 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:45.333582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:45.334029 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:45.403689 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:45.412130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9d44842b-92aa-4252-bd1a-0d1cecb08931 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1201 microversion: 2.1 time: 0.092056 Aug 08 17:42:45.425960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2342/3663] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:45 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:46.432353 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:46.433058 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:46.440011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:46.440501 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:46.440937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:46.441634 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:46.442153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:46.442579 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:46.665621 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:46.673990 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c8679e1d-2b0b-40cf-aeb4-1d3023b25f83 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1279 microversion: 2.1 time: 0.245353 Aug 08 17:42:46.674651 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2343/3664] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:46 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:47.235762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61a7e28-6bcf-4b95-972f-2e683c98c80c", "tag": "2289e131-9613-4e70-b1a6-ccd97bea663e"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:42:47.245011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:47.245488 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:47.245946 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:47.257468 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] Creating event network-changed:2289e131-9613-4e70-b1a6-ccd97bea663e for instance d61a7e28-6bcf-4b95-972f-2e683c98c80c on hv-cinder-85221 Aug 08 17:42:47.262826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-2a0471c1-4512-49f5-9f74-1b0750959aca req-f03f9021-8004-4965-af3b-b33f8b074d32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031197 Aug 08 17:42:47.263424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2344/3665] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:42:47.697532 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:47.698257 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:47.704392 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:47.704879 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:47.705316 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:47.706030 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:47.706489 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:47.706913 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:48.141537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:48.149227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2d92b5b8-b975-4711-b45d-479a028ce86a tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.456394 Aug 08 17:42:48.149805 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2345/3666] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:47 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:49.171047 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:49.171627 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:49.177963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:49.178443 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:49.178919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:49.179594 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:49.180039 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:49.180456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:49.313492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:49.321060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2452c7b4-0a4b-417b-87f3-840e46b5efda tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.154438 Aug 08 17:42:49.321624 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2346/3667] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:49 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:50.342010 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:50.342625 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:50.349302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:50.349999 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:50.350433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:50.351121 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:50.351569 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:50.351987 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:50.486782 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:50.494383 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dbf58f64-44b0-41ad-9dfd-3e2ecb6a6079 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.156309 Aug 08 17:42:50.494944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2347/3668] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:50 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:51.515519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:51.516378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:51.523053 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:51.523549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:51.524014 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:51.524710 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:51.525198 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:51.525626 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:51.657944 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:51.665378 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0486439c-af3d-4105-951c-61a0a2a6f6ec tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.154365 Aug 08 17:42:51.665965 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2348/3669] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:51 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:52.686603 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:52.687226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:52.689696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=2 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:52.694806 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:52.695289 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:52.695722 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:52.696659 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:52.697118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:52.697538 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:52.826276 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:52.834393 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-aebced09-fa89-4b92-8b0d-33cb30f0dcfe tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.152074 Aug 08 17:42:52.845845 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2349/3670] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:52 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:53.855606 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:53.856227 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:53.858144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell0:SELECT=8 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:53.863250 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:53.863729 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:53.864160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:53.864837 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:53.865283 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:53.865698 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:54.000781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:54.008225 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-858d9e54-3b0c-4436-ae2c-e8d9b8e0bc7c tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.156529 Aug 08 17:42:54.008784 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2350/3671] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:53 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:55.028781 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:55.029986 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:55.036824 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:55.037309 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:55.037741 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:55.038449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:55.038903 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:55.039326 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:55.175203 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:55.182679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-59bd88dd-6cde-42b6-ba63-d2b8eff53887 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.157959 Aug 08 17:42:55.183249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2351/3672] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:55 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:56.204441 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:56.205883 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:56.212357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:56.212844 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:56.213282 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:56.214008 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:56.214464 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:56.214889 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:56.358078 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:56.365470 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-a2cfe368-221a-487d-9015-719a35bd2df2 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.166281 Aug 08 17:42:56.368357 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2352/3673] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:56 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:57.385380 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:57.386049 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:57.392688 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:57.393246 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:57.393696 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:57.394463 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:57.394967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:57.395723 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:57.528843 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:57.537101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-c9aa5d8c-1af3-4cda-ac88-f8d83f430871 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.155543 Aug 08 17:42:57.539241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2353/3674] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:57 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:58.418941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61a7e28-6bcf-4b95-972f-2e683c98c80c", "name": "network-vif-plugged", "status": "completed", "tag": "2289e131-9613-4e70-b1a6-ccd97bea663e"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:42:58.429449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:58.429967 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:58.430416 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:58.442184 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] Creating event network-vif-plugged:2289e131-9613-4e70-b1a6-ccd97bea663e for instance d61a7e28-6bcf-4b95-972f-2e683c98c80c on hv-cinder-85221 Aug 08 17:42:58.447130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-7dc4452b-cb15-49db-8ca6-729461828b76 req-54da7838-5d75-4e65-9f92-804dac2fd4fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Aug 08 17:42:58.447715 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2354/3675] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:42:58.564074 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:58.565368 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:58.571801 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:58.572286 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:58.572718 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:58.573408 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:58.574087 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:58.574516 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:58.720675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:58.730374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-7023100e-cde3-4260-89e6-53e8974c861b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.175620 Aug 08 17:42:58.730881 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2355/3676] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:58 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:42:59.752219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:42:59.752924 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:42:59.759272 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:59.759756 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:59.760196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:59.760911 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:42:59.761375 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:42:59.761817 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:42:59.900636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:42:59.908177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-556e48c0-767e-4055-82be-bf42183b8597 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1267 microversion: 2.1 time: 0.160376 Aug 08 17:42:59.908739 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2356/3677] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:42:59 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:43:00.928704 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:43:00.929360 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:43:00.935738 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:43:00.936215 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:43:00.936644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:43:00.937317 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:43:00.937764 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:43:00.938205 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:43:01.068652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:43:01.076379 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-9f5b3df2-fa4f-416a-991c-dcb86fa26032 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1453 microversion: 2.1 time: 0.151801 Aug 08 17:43:01.080352 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2357/3678] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:43:00 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:43:01.096829 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:43:01.097460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:43:01.103302 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:43:01.103842 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:43:01.104275 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:43:01.104952 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:43:01.105397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:43:01.105832 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:43:01.123834 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=100 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:01.240978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:43:01.248549 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-01e33385-83d4-4640-89a7-a1499f3a4e2f tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1453 microversion: 2.1 time: 0.155589 Aug 08 17:43:01.249151 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2358/3679] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:43:01 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:43:03.271714 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61a7e28-6bcf-4b95-972f-2e683c98c80c", "tag": "2289e131-9613-4e70-b1a6-ccd97bea663e"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:43:03.282658 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:43:03.283214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:43:03.283823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:43:03.295867 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] Creating event network-changed:2289e131-9613-4e70-b1a6-ccd97bea663e for instance d61a7e28-6bcf-4b95-972f-2e683c98c80c on hv-cinder-85221 Aug 08 17:43:03.300915 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-ee3844d7-599a-4bf3-a51c-70c65decc25d req-08bbce2c-656a-49e8-b977-b14159244fd4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033144 Aug 08 17:43:03.301591 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2359/3680] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:43:41.631336 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:43:41.631864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:43:45.490449 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:43:45.491093 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:43:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:44:36.341001 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:36.341826 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG dbcounter [-] [130501] Writing DB stats nova_cell1:SELECT=4 {{(pid=130501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:36.346593 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:36.347262 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:36.353229 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:36.353780 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:36.354307 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:36.355061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:36.355509 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:36.355978 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:36.383798 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:44:36.606622 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e6138a08-689d-4d7a-a349-50178d215801 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 204 len: 0 microversion: 2.1 time: 0.268485 Aug 08 17:44:36.607214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2360/3681] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:44:36 2022] DELETE /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:44:36.731587 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61a7e28-6bcf-4b95-972f-2e683c98c80c", "tag": "2289e131-9613-4e70-b1a6-ccd97bea663e"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:44:36.741127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:36.741611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:36.742072 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:36.752874 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] Creating event network-changed:2289e131-9613-4e70-b1a6-ccd97bea663e for instance d61a7e28-6bcf-4b95-972f-2e683c98c80c on hv-cinder-85221 Aug 08 17:44:36.757585 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-93090511-d7cd-4cb7-9d30-77659b940e05 req-c1a9838f-dd27-4934-8b44-82a943464103 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149113 Aug 08 17:44:36.758210 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2361/3682] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:44:36.763555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:36.764249 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:36.770189 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:36.770667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:36.771101 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:36.771788 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:36.772241 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:36.772664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:36.904920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:36.913116 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0707094d-28ed-419f-af22-10c63dd33df7 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1577 microversion: 2.1 time: 0.153790 Aug 08 17:44:36.913812 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2362/3683] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:36 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:44:37.933424 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:37.934114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:37.940351 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:37.943456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:37.943456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:37.943456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:37.943456 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:37.943890 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:38.074862 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:38.082814 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-17e427a5-1548-45cc-a498-d9435613d147 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1577 microversion: 2.1 time: 0.153226 Aug 08 17:44:38.083374 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2363/3684] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:37 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:44:39.104835 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:39.105436 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:39.112381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:39.112929 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:39.113296 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:39.114019 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:39.114476 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:39.114899 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:39.181697 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:39.189336 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2affd6f4-ad7b-4ee3-b43a-4b4fdbb61c85 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1391 microversion: 2.1 time: 0.088648 Aug 08 17:44:39.189920 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2364/3685] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:39 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1391 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:44:39.249612 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61a7e28-6bcf-4b95-972f-2e683c98c80c", "name": "network-vif-deleted", "tag": "2289e131-9613-4e70-b1a6-ccd97bea663e"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:44:39.259196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:39.259675 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:39.260108 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:39.271877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] Creating event network-vif-deleted:2289e131-9613-4e70-b1a6-ccd97bea663e for instance d61a7e28-6bcf-4b95-972f-2e683c98c80c on hv-cinder-85221 Aug 08 17:44:39.277024 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-78908a3f-671e-4397-8c13-8a91118ee1d5 req-2e603281-535a-4b14-82b5-c5c01e837369 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085968 Aug 08 17:44:39.277582 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2365/3686] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:44:40.210177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:40.214728 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:40.217389 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:40.217906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:40.218340 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:40.219013 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:40.219713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:40.220130 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:40.250511 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:40.251011 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:40.251439 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:40.251880 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.objects.instance [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lazy-loading 'fault' on Instance uuid d61a7e28-6bcf-4b95-972f-2e683c98c80c {{(pid=130501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:44:40.292114 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:40.300135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-f52e6e5c-306a-4594-84f0-b5531b6e562b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 200 len: 1231 microversion: 2.1 time: 0.094237 Aug 08 17:44:40.300713 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2366/3687] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:40 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:44:41.325927 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:41.327044 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: d61a7e28-6bcf-4b95-972f-2e683c98c80c] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:41.333331 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:41.333841 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:41.334284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:41.334960 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:41.335413 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:41.335836 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:41.351628 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] HTTP exception thrown: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Request method failure captured: Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c HTTP/1.1 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnHOjTTvb7KOFSdLLh-xOgUHScbjaR7OxpPt12LBWQvLgE4VcbE1X3jD6mtoUZJ5M8zw3BMh7MAniXkfHTiuhBinv2y1Fu39ALp4Rv0ZUwD-7Ipwfbax61-UK5hlTg3QKVU8jLOfrwJknEyHVmXKf5dNl9zrdH_EjUvA-6ke2Qh8Eg Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:44:41.353226 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f857768418e43d8bdbab85be767b896", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f857768418e43d8bdbab85be767b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 57662358169d4830b2ebb7d594efb701 Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. Aug 08 17:44:41.354519 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'd61a7e28-6bcf-4b95-972f-2e683c98c80c'} Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:44:41.355188 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. Aug 08 17:44:41.356492 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:41.357695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Returning 404 to user: Instance d61a7e28-6bcf-4b95-972f-2e683c98c80c could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:44:41.357695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0d054dac-45a7-465c-8a7f-ad7fff55d6a6 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c" status: 404 len: 111 microversion: 2.1 time: 0.032668 Aug 08 17:44:41.357695 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2367/3688] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:41 2022] GET /compute/v2.1/servers/d61a7e28-6bcf-4b95-972f-2e683c98c80c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:44:44.637060 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:44.637631 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:44.644831 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:44.645321 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:44.645762 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:44.646667 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:44.647127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:44.647552 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:44.672608 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Going to try to terminate instance {{(pid=130501) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:44:44.995169 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-45ecec53-85e5-4069-b291-f65664ae83ea tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "DELETE /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 204 len: 0 microversion: 2.1 time: 0.361961 Aug 08 17:44:44.995778 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2368/3689] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:44:44 2022] DELETE /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:44:45.004515 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922b5083-289e-40f5-86d3-692e536efee2", "tag": "bcdc4c06-3696-4acd-8a14-f7e93921b2cd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:44:45.014589 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:45.015079 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:45.015542 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:45.026481 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] Creating event network-changed:bcdc4c06-3696-4acd-8a14-f7e93921b2cd for instance 922b5083-289e-40f5-86d3-692e536efee2 on hv-cinder-85221 Aug 08 17:44:45.031334 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-04d0a527-1969-49f9-b990-1d7875d43158 req-35855de5-afc7-4d4b-9471-a585274a6902 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030713 Aug 08 17:44:45.034180 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2369/3690] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:44:45.036827 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:45.037510 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:45.043613 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:45.044118 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:45.044555 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:45.045734 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:45.046219 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:45.046644 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:45.180420 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:45.187989 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-39d04c89-0c5c-4a4e-9d2e-a3a783173783 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1576 microversion: 2.1 time: 0.155007 Aug 08 17:44:45.188554 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2370/3691] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:45 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:44:46.209919 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:46.210617 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:46.216937 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:46.218148 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:46.218590 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:46.219547 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:46.220033 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:46.220460 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:46.356199 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:46.363727 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-2017899b-a341-4878-9e5b-473d75bf5843 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1576 microversion: 2.1 time: 0.157712 Aug 08 17:44:46.364299 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2371/3692] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:46 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:44:47.207559 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922b5083-289e-40f5-86d3-692e536efee2", "name": "network-vif-deleted", "tag": "bcdc4c06-3696-4acd-8a14-f7e93921b2cd"}]} {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:44:47.216909 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:47.220160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:47.220160 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:47.229022 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.compute.server_external_events [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] Creating event network-vif-deleted:bcdc4c06-3696-4acd-8a14-f7e93921b2cd for instance 922b5083-289e-40f5-86d3-692e536efee2 on hv-cinder-85221 Aug 08 17:44:47.234546 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [req-fad81959-c0a1-4ba1-8a4f-446215b45e4f req-e8ab0889-39a1-4348-b59e-7f2bf887ce5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030609 Aug 08 17:44:47.235155 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2372/3693] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Aug 8 17:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:44:47.385012 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:47.385652 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:47.391671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:47.392182 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:47.392611 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:47.393294 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:47.393749 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:47.394202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:47.456002 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.policy [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57662358169d4830b2ebb7d594efb701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f857768418e43d8bdbab85be767b896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130501) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:44:47.463381 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-dc94d51a-8a80-4906-9b28-0d20bfc8fa45 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 200 len: 1225 microversion: 2.1 time: 0.082638 Aug 08 17:44:47.463941 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2373/3694] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:47 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:44:48.484985 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:48.487671 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: 922b5083-289e-40f5-86d3-692e536efee2] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:48.492176 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:48.492700 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:48.493144 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:48.493931 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:48.494394 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:48.494877 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:48.508664 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] HTTP exception thrown: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Request method failure captured: Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 HTTP/1.1 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnHOjTTvb7KOFSdLLh-xOgUHScbjaR7OxpPt12LBWQvLgE4VcbE1X3jD6mtoUZJ5M8zw3BMh7MAniXkfHTiuhBinv2y1Fu39ALp4Rv0ZUwD-7Ipwfbax61-UK5hlTg3QKVU8jLOfrwJknEyHVmXKf5dNl9zrdH_EjUvA-6ke2Qh8Eg Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:44:48.513214 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f857768418e43d8bdbab85be767b896", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f857768418e43d8bdbab85be767b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 57662358169d4830b2ebb7d594efb701 Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. Aug 08 17:44:48.514521 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': '922b5083-289e-40f5-86d3-692e536efee2'} Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:44:48.515177 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. Aug 08 17:44:48.516359 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:48.518196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Returning 404 to user: Instance 922b5083-289e-40f5-86d3-692e536efee2 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:44:48.518196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-01de1103-98d1-42c6-b59e-37d6d3794cf0 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2" status: 404 len: 111 microversion: 2.1 time: 0.031075 Aug 08 17:44:48.518196 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2374/3695] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:48 2022] GET /compute/v2.1/servers/922b5083-289e-40f5-86d3-692e536efee2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:44:48.998706 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:48.999206 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:49.004955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:49.005430 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:49.005921 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:49.006596 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:49.007040 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:49.007455 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:49.022449 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] HTTP exception thrown: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Request method failure captured: Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: DELETE /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 HTTP/1.1 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnHOjTTvb7KOFSdLLh-xOgUHScbjaR7OxpPt12LBWQvLgE4VcbE1X3jD6mtoUZJ5M8zw3BMh7MAniXkfHTiuhBinv2y1Fu39ALp4Rv0ZUwD-7Ipwfbax61-UK5hlTg3QKVU8jLOfrwJknEyHVmXKf5dNl9zrdH_EjUvA-6ke2Qh8Eg Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:44:49.023963 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f857768418e43d8bdbab85be767b896", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f857768418e43d8bdbab85be767b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 57662358169d4830b2ebb7d594efb701 Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.025397 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'f8bddccb-7316-4a1c-a94a-10307d7e6a33'} Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:44:49.026135 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.027200 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.028284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Returning 404 to user: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:44:49.028284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-083c4704-9b15-47e0-9432-392182e5ba7b tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 404 len: 111 microversion: 2.1 time: 0.030880 Aug 08 17:44:49.028284 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2375/3696] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Aug 8 17:44:48 2022] DELETE /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:44:49.034077 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:49.034679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.compute.api [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [instance: f8bddccb-7316-4a1c-a94a-10307d7e6a33] Fetching instance by UUID {{(pid=130501) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:44:49.040153 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:49.040629 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:49.041061 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:49.041761 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Acquiring lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:44:49.042232 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:44:49.042655 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG oslo_concurrency.lockutils [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Lock "3cbdaf28-93b6-4787-a2ab-078d88b45544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:44:49.055935 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.wsgi [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] HTTP exception thrown: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Request method failure captured: Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: request: GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 HTTP/1.1 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept: application/json Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Accept-Encoding: identity Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Connection: close Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Length: 0 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Content-Type: application/json Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Host: 10.222.0.57 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Openstack-System-Scope: None Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: User-Agent: python-urllib3/1.26.11 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Auth-Token: gAAAAABi8UnHOjTTvb7KOFSdLLh-xOgUHScbjaR7OxpPt12LBWQvLgE4VcbE1X3jD6mtoUZJ5M8zw3BMh7MAniXkfHTiuhBinv2y1Fu39ALp4Rv0ZUwD-7Ipwfbax61-UK5hlTg3QKVU8jLOfrwJknEyHVmXKf5dNl9zrdH_EjUvA-6ke2Qh8Eg Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Id: None Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Domain-Name: None Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Identity-Status: Confirmed Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Is-Admin-Project: True Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Id: default Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Domain-Name: Default Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Project-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Role: member,reader Aug 08 17:44:49.057433 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Roles: member,reader Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0f857768418e43d8bdbab85be767b896", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0f857768418e43d8bdbab85be767b896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0f857768418e43d8bdbab85be767b896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Id: 0f857768418e43d8bdbab85be767b896 Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-Tenant-Name: tempest-TestVolumeBootPattern-1657241996 Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Id: default Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Domain-Name: Default Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Id: 57662358169d4830b2ebb7d594efb701 Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: X-User-Name: tempest-TestVolumeBootPattern-1657241996-project Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: method: > Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: exception: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.058854 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: action_args: {'id': 'f8bddccb-7316-4a1c-a94a-10307d7e6a33'} Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:44:49.059692 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. Aug 08 17:44:49.060774 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR nova.api.openstack.wsgi Aug 08 17:44:49.061823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Returning 404 to user: Instance f8bddccb-7316-4a1c-a94a-10307d7e6a33 could not be found. {{(pid=130501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:44:49.061823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-e36242a8-3e4e-4864-a0e8-8596099922a4 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33" status: 404 len: 111 microversion: 2.1 time: 0.028970 Aug 08 17:44:49.061823 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2376/3697] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Aug 8 17:44:49 2022] GET /compute/v2.1/servers/f8bddccb-7316-4a1c-a94a-10307d7e6a33 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:44:50.599906 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: DEBUG nova.api.openstack.wsgi [None req-0d2974d5-a2c0-4171-b8a8-c0398b229527 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] Calling method '.version_select at 0x7f743cfdf430>' {{(pid=130501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:44:50.604537 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d2974d5-a2c0-4171-b8a8-c0398b229527 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [07a0ae2e-bd3f-45a5-9246-0eca28d97f20] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 17:44:51.611202 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d2974d5-a2c0-4171-b8a8-c0398b229527 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] [07a0ae2e-bd3f-45a5-9246-0eca28d97f20] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 60994. Aug 08 17:44:51.687358 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO nova.api.openstack.requestlog [None req-0d2974d5-a2c0-4171-b8a8-c0398b229527 tempest-TestVolumeBootPattern-1657241996 tempest-TestVolumeBootPattern-1657241996-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174986336" status: 202 len: 0 microversion: 2.1 time: 1.091199 Aug 08 17:44:51.687955 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: [pid: 130501|app: 0|req: 2377/3698] 10.222.0.57 () {58 vars in 1263 bytes} [Mon Aug 8 17:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174986336 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:45:49.536054 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:45:49.536634 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:47:01.638947 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:47:01.639567 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:47:05.500196 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:47:05.500864 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:47:29.441636 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:47:29.442127 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:48:44.439916 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:48:44.440493 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:49:09.543460 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:49:09.543965 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:49:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:50:19.909961 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:50:19.910679 dv-cinder-852210-3-iscsi devstack@n-api.service[130501]: Mon Aug 8 17:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:50:21.646811 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:50:21.648244 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!! Aug 08 17:50:25.509976 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:50:25.510572 dv-cinder-852210-3-iscsi devstack@n-api.service[130500]: Mon Aug 8 17:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c06d12-050a-4dbb-9d04-30953de7661e (ip 10.222.0.57) !!!